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^ , Abstract 

The Markowitz problem consists of finding in a financial market a self-financing 
trading strategy whose final wealth has maximal mean and minimal variance. We 
study this in continuous time in a general semimartingale model and under cone 
constraints: Trading strategies must take values in a (possibly random and time- 
rs) ■ dependent) closed cone. We first prove existence of a solution for convex constraints 
by showing that the space of constrained terminal gains, which is a space of stochas- 
tic integrals, is closed in I? . Then we use stochastic control methods to describe the 
local structure of the optimal strategy, as follows. The value process of a naturally 
associated constrained linear-quadratic optimal control problem is decomposed into 
a sum with two opportunity processes appearing as coefficients. The martin- 
gale optimality principle translates into a drift condition for the semimartingale 
characteristics of or equivalently into a coupled system of backward stochastic 
differential equations for L ± . We show how this can be used to both characterise 
and construct optimal strategies. Our results explain and generalise all the results 
available in the literature so far. Moreover, we even obtain new sharp results in the 
unconstrained case. 
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1 Introduction 



Mean-variance portfolio selection is a classical problem in finance. It consists of finding 
in a financial market a self-financing trading strategy whose final wealth has maximal 
mean and minimal variance. It is often called the Markowitz problem after its inventor 
Harry Markowitz who proposed it in a one-period setting as a formulation for portfolio 
optimisation; see [23] and [25] . We study this problem here in continuous time in a 
general semimartingale model and under cone constraints, meaning that each allowed 
trading strategy is restricted to always lie in a closed cone which might depend on the 
state and time in a predictable way. For applications in the management of pension funds 
and insurance companies, the inclusion of such constraints into the setup is very useful 
as they allow to model regulatory restrictions, like for example no shortselling. 

As in the unconstrained case, the solution to the Markowitz problem can be obtained 
by solving the particular mean-variance hedging problem of approximating in L 2 a con- 
stant payoff by the terminal gains of a self-financing trading strategy. To get existence of a 
solution to the latter problem, we show first that the space Gt(£) of constrained terminal 
gains is closed in L 2 ; this is sufficient if the constraints, and hence GV(£), are in addition 
convex. Our approach here combines the space of (L 2 -)admissible trading strategies of 
Cerny and Kallsen [1] with ^-martingales, a generalisation of martingales introduced by 
Choulli, Krawczyk and Strieker [6]. The latter notion comes up naturally in quadratic 
optimisation problems in mathematical finance due to the negative "marginal utility" of 
the square function. The closedness result and hence the existence of optimal strategies 
for the constrained Markowitz problem constitute a first major contribution, especially in 
view of the generality of our setting. In particular, this allows us to obtain in Theorem 
16.21 a new sharp result for the unconstrained case. 

Our main focus and achievement, however, is the subsequent structural description 
of the optimal strategy by its local properties. This is made possible by treating the 
approximation in L 2 as a problem in stochastic optimal control and systematically using 
ideas and results from there. By exploiting the quadratic and conic structure of our 
task, we first obtain a decomposition of its value process J(x, i?) into a sum involving 
two auxiliary coefficient processes. This is similar to the results by Cerny and Kallsen 
[I] in the unconstrained case, but now requires two opportunity processes L 1 * 1 , due to the 
constraints. An analogous opportunity process also plays a central role in the analysis by 
Nutz [27] of power utility maximisation, and some of the ideas and techniques are similar. 
Using the martingale optimality principle for J(x, $) next allows us to describe first the 
drift of L^ 1 and from there the optimal strategy locally in feedback form via the pointwise 
minimisers of two predictable functions g ± ; these are given in terms of the joint differential 
semimartingale characteristics of the opportunity processes L ± and the price process S. 
The drift equations can also be rewritten as a system of coupled backward stochastic 
differential equations (BSDEs) for L ± , and we show that the opportunity processes are the 
maximal solutions of this system. This is motivated by a similar result in |27j . Conversely, 
we also prove verification results saying that if we have minimisers of g ± (or a solution to 
the BSDE system), then we can construct from there an optimal strategy. This explains 
and generalises all results so far in the literature on the Markowitz problem under cone 
constraints; see [22], [13], [20] and [T6] . 

The generality of our framework allows us to capture a new behaviour of the optimal 
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strategy: It jumps from the minimiser of one predictable function to that of a second 
one, whenever the optimal wealth process of the approximation problem changes sign. 
Because this phenomenon is due to jumps in the price process S of the underlying assets, 
it could not be observed in earlier work since the Markowitz problem under constraints 
has so far only been studied in (continuous) Ito process models. Not surprisingly, the 
presence of jumps and the resulting nontrivial coupling of the BSDEs make the situation 
more involved; we explain in Section [6] how things quickly simplify if S is continuous. 
The usefulness of our general results can also be illustrated by applying them to Levy 
processes. Here the two random equations for the joint differential characteristics of 
and S reduce to two coupled ordinary differential equations. These allow us to describe 
the solution explicitly, and it turns out that its behaviour is quite different than in the 
unconstrained case; the details and examples illustrating the various effects have been 
worked out and will be presented elsewhere. 

The paper is organised as follows. Section [2] gives a precise formulation of the problem, 
recalls basic results on predictable correspondences and proves the closedness in L 2 of the 
space of constrained terminal gains. In Section^ we use dynamic programming arguments 
to establish the general structure of the value process J(x, d) in terms of the opportunity 
processes L^. Section H] exploits this via the martingale optimality principle to derive 
the local description of the optimal strategy and the characterisation of the opportunity 
processes via coupled BSDEs. Section contains the more computational parts of the 
proofs from Section HI and Section [H] concludes with a comparison to related work. 

2 Formulation of the problem and preliminaries 

Let (O, J 7 , P) be a probability space with a filtration F = (.Ft)o<t<T satisfying the usual 
conditions of completeness and right-continuity, where T > is a fixed and finite time 
horizon. We can and do choose for every local P-martingale a right-continuous version 
with left limits (RCLL for short). All unexplained notation concerning stochastic inte- 
gration can be found in the books of Jacod and Shiryaev [T3] and Protter [2S]- For local 
martingales, we use the definition in j2S]. 

We consider a. financial market consisting of one riskless asset, whose (discounted) price 
is 1, and d risky assets described by an Revalued RCLL semimartingale S = (S t )o<t<T- 
We suppose that S is locally square-integrable, S £ Hf oc (P), in the sense that S is special 
with canonical decomposition S = Sq + M + A, where M is an Revalued locally square- 
integrable local martingale null at zero, M £ Ai^ loc (P), and A is an Revalued predictable 
RCLL process of finite variation and null at zero. Using semimartingale characteristics, 
we write (M) = c M • B and A = b s • B, where all processes are predictable, B is RCLL 
and strictly increasing and null at 0, and c M is d x d-matrix- valued. For details, see 
Section II. 2 in [T5] or Section @] below. On the product space f2 := Q x [0, T] with the 
predictable <r-field V, define Pb '■= P <S> B. As trading strategies available for investment, 
we consider a set €. of S'-integrable, Revalued, predictable processes; this will be specified 
more precisely later. We call £ unconstrained if £ is a linear subspace and constrained 
otherwise. By trading with a strategy •& £ €. up to time t £ [0, T] in a self-financing way, 
an investor with initial capital x £ R can generate the wealth 

Vt^x.d) := x + f $ u dS u =: x + ti'Sf 
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In this paper, we understand mean-variance portfolio selection as in the usual Marko- 
witz problem, i.e. as the static optimisation problem of finding a (dynamic) self-financing 
trading strategy whose final wealth has maximal mean and minimal variance. This is 
static in the sense that we only consider the optimisation at the initial time without 
looking at intermediate conditional versions. Mathematically, this can be formulated as 

maximise E[V T {x, ■&)] - | Vax\V T {x, •&)] over all •& G €, (2.1) 

where the parameter 7 > describes the risk aversion of the investor. The most common 
alternative formulation is to 

minimise Var[Vr(cc, $)] = i?[|Vr(^, i?)| 2 ] — m 2 

subject to E[V T (x, #)] = m > x and ■& G €. (2.2) 

If € = & is a cone, we obtain from the purely geometric structure of the optimisation 
problems the following global description of the solutions to ( 12.1 p and (12. 2p . 

Lemma 2.1. If <£ = & is a cone and if we have <p m St ^ 1 and E\fp* St] > 0, then the 
solutions to (12.11) and (I2.2p are given by 

7 E [1 — ip • St\ E[ip m bT\ 

respectively, where tp is the solution to 

minimise E[\V T (-l,$)\ 2 ]= E[\l-$-S T \ 2 ] over all ■& G <t (2.4) 

Proof. This follows from the arguments in the proof of Proposition 3.1 and Theorem 4.2 
in [31] which are derived in an abstract L 2 -setting by Hilbert space arguments. Note that 
the convexity assumed in [31] is not necessary for the equations (12.31) to hold; it is used 
in [31] only for the existence of a solution to (12.41) . which we do not assert here. □ 

If C is a convex set, but not necessarily a cone, one can under suitable feasibility 
conditions still establish the existence of a solution to (12. ip and ( 12. 2 p by using Lagrange 
multipliers; see |20j and [11]. However, these solutions admit less structure so that their 
dynamic behaviour over time cannot be described very explicitly. We therefore con- 
centrate from Section [3] onwards on constraints which are given by cones. Before that, 
however, we want to prove existence of an optimal strategy in a continuous-time setting. 

We first observe that despite its simplicity, Lemma 12.11 is very useful as it relates the 
solution to the Markowitz problems ( 12. ip and (12. 2p to the solution of a constrained mean- 
variance hedging problem, namely minimising the mean-squared hedging error between a 
given payoff H G L 2 (P) and a constrained self-financing trading strategy, i.e. to 

minimise E [\V T (x,#) - H\ 2 ] = E [\x + tf-S T - H\ 2 ] over all $ G C (2.5) 

Indeed, ( 12. 4p corresponds to the very particular version of this problem with H = and 
x — —1, or H = 1 and x — 0. Since (12. 5 p is an approximation problem in the Hilbert 
space L 2 (P), it admits a solution for arbitrary H G L 2 (P) if the space 

G T (C) = {tf-S T \$e £} 
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of terminal constrained gains is convex and closed in L 2 (P). Such constrained mean- 
variance hedging problems in a general semimartingale framework have been studied in 
[7] . As explained there, one can formulate constraints on trading strategies and then adapt 
closedness results from the unconstrained case to obtain closedness under constraints as 
well. This needs a suitable choice of strategies and constraints which we now introduce. 

Conceptually, our choice of strategy space can be traced back to Cerny and Kallsen |3]. 
They start with simple integrands of the form $ = Y^i=i £i-^]a»,o-i+i] with stopping times 
< o\ < ■ ■ ■ < a m < r n < T for some n G N and bounded Revalued Jv r measurable ran- 
dom variables £j for i — 1, . . . , m— 1, where (r ra ) is a localising sequence of stopping times 
with S Tn G T-L 2 (P). Their (L 2 -)admissible strategies are then those integrands $ G C(S) 
for which there exists a sequence ($ n )neN of simple integrands such that 

1) & n 'S T L ^ tf*S T . 

2) 0*-St -A for all t G [0,T]. 

A discussion why such a class of strategies is economically reasonable and mathematically 
useful can be found in [2]. For our purposes, we need to modify that definition a little. 

Instead of simple strategies, another natural space of strategies coming from the con- 
struction of the stochastic integral is := ©s := C 2 (M) H C 2 (A) with 

£ 2 (M) := {# G £°(U,V;R d ) \ \\0\\c* m ■= (E[J^Jd(M) s ^ < oo}, 
C\A) := {tf G C°(U,V;R d ) | McHA) := {E[(ff WJdA s \) 2 ])^ < oo}. 
Next, the trading constraints we consider are formulated via predictable correspondences. 

Definition 2.2. A correspondence is a mapping C : Q — > 2 Rd . We call a correspondence 
C predictable if C _1 (F) := {(to,t) \ C(u,t) fl F 7^ 0} is a predictable set for all closed 
sets F C R d . The domain of a correspondence C is dom(C) := {(u),t) \ C(u),t) 7^ 0}. 
A (predictable) selector of a (predictable) correspondence C is a (predictable) process -0 
with ip(u,t) G C(u,t) for all G dom(C). 

For a correspondence C : — > 2 Rd \ {0}, the sets of C-valued or C-constrained 
integrands and of square-integrable C-constrained trading strategies are given by 

C := C 5 := {d G £(5) I t) G C(w, i) for all (u, t) G H}, 
9(C) := D C = G I &(u, t) G C(w, t) for all (u, t) G tt}. 

Definition 2.3. A trading strategy d G C is called C-admissible (in L 2 (P) ) if there exists 
a sequence ($ n ) n en in 0(C), called approximating sequence for $, such that 

1) tf n '£ T — W $ m St- 

p 

2) -d n 'S T — > fl'Sr for all stopping times r. 

The set of all C-admissible trading strategies is called 0(C), and we set := 0(IR d ). 
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In comparison to Cerny and Kallsen [4], there are two differences. Instead of using 
simple strategies for the approximation, we use strategies from 0(C); the reason is that 
it can easily happen with time-dependent constraints that no simple strategy satisfies 
them. (The constraints can also be so bad that no strategy in G satisfies them either; but 
such situations are almost pathological.) The second difference is that we stipulate 2) for 
all stopping times r and not only for deterministic times t; this is needed for dynamic 
programming arguments, as explained at the end of this section. 

Before addressing the issue of closedness of GV(Q(C)) in L 2 (P), we recall some results 
on predictable correspondences, used later to ensure the existence of predictable selectors. 

Proposition 2.4 (Castaing). For a correspondence C : Q — > 2 Rd with closed values, the 
following are equivalent: 

1) C is predictable. 

2) dom(C) is predictable and there exists a Castaing representation of C, i.e. a se- 
quence (ip n ) of predictable selectors of C such that 

C(u>, t) = {ip l (uj, t),ip 2 (uj, t), . . .} for each (u, t) G dom(C). 

In particular, every closed-valued predictable C admits a predictable selector if). 

Proof. See Corollary 18.14 in pQ or Theorem IB in [29]. □ 

Proposition 2.5. Let C : Q — > 2 Rd be a predictable correspondence with closed values 
and f : O x R m -» R d and g : fi x R d -> R m Caratheodory functions, which means that 
f(u,t,y) and g(u,t,x) are predictable with respect to (u),t) and continuous in y and x. 
Then the mappings C and C" given by C'(u,t) = {y G M m | f(co, t, y) G C(u),t)} and 
C"(ou,t) = {g(co,t,x) | x G C(u,i)} are predictable correspondences (from Q to 2 Rm ) with 
closed values. 

Proof. See Corollaries IP and 1Q in [29]. □ 

Proposition 2.6. Let C n : Q — > 2 Rd for each n G N be a predictable correspondence with 
closed values and define the correspondences C and C" by C'(u,t) = f]C n (u,t) and 

n€N 

C"(u,t) = (J C n (u,t). Then C and C" are predictable and C is closed-valued. 

nGN 

Proof. See Theorem 1M in [29] and Lemma 18.4 in [I]. □ 

Now we aim to prove closedness in L 2 (P) of the space of constrained terminal gains. 
Because we are interested in solving f)2.4p in maximal generality, we combine ideas and 
concepts from [4] and [6]. Like Cerny and Kallsen in [4], we use the (modified) space 
Gt(Q(C)) of (L 2 -) admissible trading strategies, but we drop the assumption from [4] that 
there exists an equivalent local martingale measure (ELMM) Q for S with ^ G L 2 (P). 
(To illustrate why this is useful, consider the simple case where S is a Poisson process. 
Then one can compute straightforwardly that the solution to f)2.4p is given by ip = 1[o,t]> 
where r = inf{£ > | AS t = 1} A T. However, there exists no E(L)MM because each 
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integrand d = c > is an arbitrage opportunity.) Like Choulli, Krawczyk and Strieker 
in [6], we impose instead of the existence of an ELMM Q the more general absence-of- 
arbitrage condition that S is an £-local martingale; but unlike [6], we do not require a 
reverse Holder inequality. 

Let us first recall the notion of an ^-martingale. For a semimartingale Y, we denote its 
stochastic exponential by S(Y). Throughout this paper, we let A" stand for a local 
P-martingale null at zero and Z N for a strictly positive adapted RCLL process. 
We shall see below how N and Z N are related. For any stopping time r, we denote the 
process Y stopped at r by Y T and the process Y started at r by T Y := Y — Y T ; but we 
set T £(N) := £(N — N T ). So for stochastic exponentials, T £(N) denotes a multiplicative 
rather than an additive restarting. Since iV is RCLL, it has at most a finite number 
of jumps with AA" = —1, and so there is P-a.s. at most a finite number of times, not 
depending on r, where the T £(N) can jump to zero; this follows from the representation 
of the stochastic exponential in Theorem 11.37 in [28J. Thus the stopping times defined 
by T = and T m+1 = inf{£ > T m \ Tm £(N) t = 0} A T increase stationarily to T. 

Definition 2.7. An adapted RCLL process Y is an £ -local martingale if the product of 
Tm Y and Tm £(N) is a local P-martingale for any m G N. It is an (£, Z N ) -martingale 
if for any m G N, we have E\\Y Tm Z^ Tm £(N) Tm+1 \\ < oo and the product of Tm Y and 
Zj. Tm £(N) is a (true) P-martingale. 

In comparison to Definition 3.11 in [6j, we have generalised the definition of £-mar- 
tingales to (£, Z^) -martingales by introducing the process Z N . This is needed for a 
clean formulation of our results, but it also makes intuitive sense. Suppose Q is an 
equivalent martingale measure for Y and write its density process with respect to P as 
Z® = Zq£(N®). By the Bayes rule, the product Y Z® is then a P-martingale and so is 
°YZ® = (Y — Yq)Z®. One consequence is that the product of °Y and £(N Q ) is a local 
P-martingale so that Y is an £(A^)-local martingale. (Of course, Z® > implies that 
T m = T for m > 1.) We also have that °YZq£(N®) is a true P-martingale so that Y is an 
(£(N®), Z^)-martingale. But unless we know more about Z® , we cannot assert that the 
product °Y£(N®) is a true P-martingale (since it need not be P-integrable); so Y is not 
an £(N®) -martingale in the sense of [B]. Hence we see that in the abstract definition, Z^ m 

plays a similar role at time T m as the density Z® of Q at time 0, and its main role is to 
ensure integrability properties. (This is not needed in [6] because the authors there work 
with Y = d • S G H 2 (P) and assume that £(N) satisfies the reverse Holder inequality 
P 2 (P). In our notation, this allows to take Z N = 1.) 

Remark 2.8. If is as above a local martingale, then J m := l]T m ,r] *£(l]]T m ,T] * Af) is for 
each m also a local martingale; if A^ is in addition locally square-integrable, then so is J m ; 
and both statements still hold if we multiply J m by a strictly positive TT m -measurable 
random variable. There is no problem with adaptedness since J m = on ]T m , T]. 

Conversely - and this will be used later - suppose A^ is a semimartingale. If J m is for 
each m a local martingale, then writing J m = (^(l]T m ,r] * ^ r )-l]T m ,T]) 'N and observing 
that £(l]r m ,T] * AT)- ^ on ]T m ,T m+ i] by the definition of T m shows that l}T m ,T m +i]'N 
is a local martingale for each m, and then so is N. Again this still holds if we replace J m 
by f3 m J m for an J^-measurable (3 m > 0, and again local square- integrability transfers, 
from J m (or (3 m J m ) to N. 



7 



The next two propositions give some information about the structure of £-local mar- 
tingales and (£, Z Af )-martingales. The results are almost literally taken from Corollaries 
3.16 and 3.17 in [6]; the proofs there still work for our generalisation. 

Proposition 2.9. Let Y be a special semimartingale and Y = Y + M Y + A Y its canon- 
ical decomposition. Then Y is an £ -local martingale if and only if [M Y , N] is locally 
P-integrable and A Y = -(M Y , N). 

Proposition 2.10. A semimartingale of the form Y = Y + M Y — (M Y , N) and satisfying 
E\Y^[Z^ m Tm £(N))* T \ < oo for any m eN is an (£, Z N ) -martingale. 

We also need the following definitions. 

Definition 2.11. We say that (£,Z ) with £ = £{N) is regular and square-integrable 
if l]T m ,T] * (Z^ m Tm £(N)) is a square-integrable (true) P-martingale and Zj, is square- 
integrable for any m. 

Lemma 2.12. Suppose (£,Z N ) with £ = £(N) is regular and square-integrable. Let 
(X n ) ne N be a sequence of (£, Z ) -martingales with X£ G L 2 (P) and X% — >■ H in L 2 (P) 
as n oo. Then there exist a subsequence (X ne )i £ fq and an £ -local martingale X given 
by X T = H and 

E[H T -£{N) T \7 t ] 

T ™£(N) t on[T m ,T m+ i[ (2.6) 

such that X ne — )■ X in the semimartingale topology (in S(P), for short) as £ — > oo. // 
£{N) satisfies the reverse Holder inequality Ri(P), then X is an (£, Z ) -martingale. 

Proof. 1) To show that X above is an £-local martingale with X? = H, we argue similarly 
as in the proof of Proposition 3.12.iii) in [6]. More precisely, we exploit that we need not 
assume £{N) to satisfy R q {P) with q = 2 as used there; it is sufficient to exploit that 
£{N) always satisfies Ri{P) in a local sense. We define for each m G N a sequence of 
stopping times if = T m l F c + Tl Fk with F k := {E[\ T ™£(N) T \ \ J* Tm ] < k} for k G N. 
Then we rewrite (12. Qh after multiplication with Z^ m as 

L t := X t Z$J™£{N) t = E[X T Z¥J m £(N) T \ F t ] on[T m ,T m+1 [ (2.7) 

and note that the right-hand side is in L l (P) since X? = H and Z^ £(N)t are both in 
L 2 (P). Hence L t l {Tm < t<Tm+l} is in L l (P) and so is then X Tm Z^J m £(N) Tm . To argue that 
X is an £-local martingale, we want to prove that ( Tm XZ^ Tm ^(iV)) T ™ is a P-martingale, 
and (12.71) already gives the martingale property for the unstopped process Tm L. So due 
to Tm X = X — X Tm , the P-integrability of L t and t™ > T m , it only remains to show that 

X Tm Z%J-£{N) thrr l {Tm < t<Tm+l] G L\P). (2.8) 

But Z^ Tm £(N) is a P-martingale and remains so after stopping by r™, and the final 
value of that stopped process is 

Z?J-£(N) rr = Z»J™£(N) Tm t F c + Z» T -£(N) T l Fh . 
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Multiplying by Xr m , conditioning on J 7 ^ and using the definition of Fk hence gives ( 12. 8P ; 
indeed, we have 

E[|X Tm Z£ T »£(J\0TM <0 °- 

This shows that X is an £-local martingale; and if £(N) satisfies Ri(P), we have Fk = £1, 
hence t™ = T, for k large enough so that X is even an (8, Z 7V )-martingale. 

2) Now fix m G N and take any subsequence of {X n ), again denoted by (X n ) in this 
step for ease of notation. Set Y n ' m := T ™X n = X n — (X n ) Tm so that by the definition 
of (8, -martingales, the product of Zj! 8(N) and Y n,m is a martingale. Note that 
(ywyjT = (X n - (X n ) T ™)l Fk and (Y m ) T ™ = (X - X T ™)l Fk for each k G N. Since 
X%^ X T = H in L 2 (P) and 

X? T ™8(N) t = E[XJ r T ™8{N) T \T t ] on [T m ,T m+1 [ (2.9) 
for the (8, Z Ar )-martingales X n by (12. 7p . we obtain for n — > oo that 

£[l W m+1 A. r - ^T m+1 A. r )^ m Tm ^(^)T m+1 A. r |] < E[\(X} - H)Z?J™8(N) T \] 

< \\X£ - H\\ L 2 {P) \\Z*J™8{N) T \\ LHP) 

tends to 0, and from the definition of t™ that for n — > oo, 

E [ I ( X T m+ 1 Ar™ - ^T m+ ! At™ ) ^T m ^ £ ( ^0 T m+ 1 Arf I ] 

= ^[|^[(^-ff)^(Ar) T |j T jz^ ( ?(Ar) Tm+lArr |] 
<^[|W-^)^ Tm ^)T|]^o. 

This gives Z^J m 8(N) TAT rn Y^™ m ->■ Z^J™8{N) ThrT Y^ in L X (P) asn^oo because 

Tm ^(A^) T = on {T m+1 < T}. Theorem 4.21 in [H] then yields a subsequence (l^' m ) i6N 
such that 

(Z^ m Tm 8(N) Y n *> m ) T ™ — )• (^Z^ m Tm 8(N) Y m ) T ™ locally in JPj oc (P) as j ^ oo 

and therefore Z$J™8{N)Y n i> m ->■ Z^ m Tm 8(N) Y m in <S(P) as j ^ oo by Theorem 
V.14 in [28]. Because zJV il l£ i N) l[r m ,r ro+ i[ is a semimartingale and the multiplication of 

semimartingales is continuous in S(P), we get ^ nj,m l|[T m ,T m+ i[ — > ^ m l[T m ,T m+ i[ in <S(P) 
as j — > oo. Note that the subsequence (n^j^ depends on m. 

3) Now we construct the desired subsequence (ne)em by a diagonal argument, as 
follows. Start with m = and the original sequence {X n ) to obtain from step 2) a 
subsequence (nj(0)) je N, and take ri\ := ni(0). Then take m = 1, apply step 2) for 
the subsequence (X nj ^) je N to get a new subsequence (rij(l))j e N, and take n 2 := rii(l). 
Iterating this procedure yields our subsequence (n^gN, and we claim that X ni — > X in 
5(P) as £ — )• oo. To see this, use the definition of Y n,m to write 

oo oo 
X n e = ST Y n *l lTm , Tm+ll + XZHT m ,T m+ll + XZ*l m . (2.10) 

m=0 m=0 
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Since l^ ni ^' m l[r mj r m+1 [ — > ^ m l[T m) T m+ i[ as j — > oo, the first sum converges in <S(P) to 

oo oo 
m=0 m=0 

where the equality now uses the definition of F m = X - X T ™ . To obtain the convergence 
of the second sum in (12.101) , we observe that 

E[W m - X Tm \Zl] = E[\E[(XZ - H) T ™£{N) T \F Tm ]\Z» m ] 

< \\X£ - H\\ L 2 {P) \\Z?J™S(N) T \\ L 2 {P) 

by f]2. 91) for all m G No and for m = 00 with := T and therefore as £ — > 00, 

00 00 

Yl Z T m X TlhT m ,T m+1 { + Xj? 1 [T] ► ^ Z l X r m l[T„ 1 ,T„,+ i[ + X T%] (2.11) 

m=0 m=0 

locally in H}(P) with the localising sequence (T m ). As local convergence in H (P) implies 
convergence in S(P) again by Theorem V.14 in [28], (12.1 ip also holds in S(P). Because 
Ylm=o ^-l[T m ,T m+ i[ is a semimartingale and the multiplication of semimartingales is con- 

tinuous in S(P), this completes the proof. □ 

Corollary 2.13. Suppose that (£,Z N ) with £ = £(N) is regular and square-integrable, 
S = S + M-{M, N) is in Hf oc (P) and (i? n ) neN is a sequence in 9 such that d n -S T ^ H 
in L 2 (P). Then d n • S is an (£, Z N ) -martingale for each n G N, and there exist d G 
with i? • St = H and 

_ E[{^S T ) T -S{N) T \n _ E[H^£{N) T \7 t ] 
* l ~ 1 -£jN) t " ^£\N) t onll m ,l m+ 4 

and a subsequence ($ nk )keN in 9 such that $ nk *S — >■ S in S(P) as k — >■ oo. 

Proof. By Proposition 12. 101 S is an £-local martingale and $ n, S is an (5, Z 7V )-martingale 
for each n. Then Lemma 12.121 gives the existence of an £-local martingale X and a 

subsequence ($ nfe ) in 9 such that Xt = H and X t = E ^ H T£rf^y~^ on [7m)^m+i[ an d 
. ,5 -> J in <S(P)- As the space of stochastic integrals is closed under convergence 
in S(P) by Theorem V.4 in [26], there exists some d G with d • S = X . Since 

convergence in «S(P) implies ucp- convergence and therefore that fl nk • S T — > $ • S T in 
probability for all stopping times r, we obtain that $ G 9 which completes the proof. □ 

To deal with the fact that different integrands may lead to the same stochastic integral 
(or, in financial terms, that we may have redundant assets), we introduce the projection on 
the predictable range. For a detailed explanation of the related issues of selecting particular 
representatives of equivalence classes of integrands as well as for sufficient conditions for 
the closedness of the projection on the predictable range for certain correspondences, we 
refer the reader to 0- 
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Proposition 2.14. For each M. -valued semimartingale Y , there exists an M. dxd -valued 
predictable process U Y , called the projection on the predictable range of Y , which takes 
values in the orthogonal projections in M. d and has the following property: If $ is in C(Y) 
and tp is predictable, then tp is in C(Y) with ip*Y = i?»Y (up to indistinguishability) if 
and only ifU Y, d = U Y (p Ps-a.e. We choose and fix one version ofU Y . 

Proof. See Lemma 5.3 in [8]. □ 

Example 2.15. For the frequently used Ito process models of the form 



II is the projection on the orthogonal complement of the kernel of oo . If each o~ t aJ is 
invertible (as is usually assumed), n y is just the identity. This holds in particular when 
m = d and each at is invertible, i.e. when the model is complete without the constraints. 

After these preparations, we obtain the closedness of Ct(0(C)) by the following the- 
orem. We recall that this implies the existence of a solution to the constrained mean- 
variance hedging problem (|2.5|) . for any payoff H G L 2 (P), if C has also convex values. 

Theorem 2.16. Suppose that (£,Z ) with £ = £(N) is regular and square-integrable 
and S = So + M — (M, N) is in H 1 2 oc (P) so that S is an £-local martingale by Proposition 
\2.9[ Let C : Q — > 2 Rd \ {0} be a predictable correspondence with closed values such 
that the projection of C on the predictable range of S is closed, i.e. IT (u,t)C(u),t) is 
PB-a.e. closed. Then Cr(0(C)) is closed in L?(P). 

Proof. Let (f? n ) be a sequence in 0(C) with d n • St — > H in L 2 (P). Using the definition 
of 0(C) and a diagonal argument yields a sequence ((p n ) in 6(C) with ip n • St —> H 
in L 2 (P). Then Corollary 12.131 implies that there exist "d G with d • St = H and a 
subsequence, again indexed by n, with ip n *S — > $ m S in S(P). Since C'S = {ip'S \ if) G C} 
is closed in S(P) by Theorem 4.5 in [8], the integrand i9 can be chosen C-valued; this 
uses the assumption on I1 5 C. As convergence in S(P) implies ucp-convergence, we obtain 
ip n • S T — > d • S T in probability for all stopping times r, and therefore d is in 0(C). This 
completes the proof. □ 

Remark 2.17. Let us briefly compare Theorem 12. 161 to the main result of Theorem 3.12 
in [7]. The latter imposes the extra assumption that £(N) satisfies the reverse Holder 
inequality R 2 (P), and proves that the space C^(0(C)) is then closed in L 2 (P). So 
Theorem 12.161 here has a weaker assumption; but since 0(C) is bigger than the space 
0(C) considered in [7], one also feels it could be easier for G^(0(C)) to be closed in 



Having clarified the existence of a solution to ( 12. 5ft or (12. 4ft , our goal in the sequel is to 
describe its structure in more detail. This is done via stochastic control techniques and in 
particular dynamic programming, and for that, we need certain properties for the space 
0(C) of strategies we work with. This is the reason why we slightly changed the definition 
in comparison to [4j: We want to show, without assuming that there exists an ELMM Q 
for S with ^5 G L 2 (P), that 0(C) is stable under bifurcation and almost stable. 




m 



L 2 



(P)- 
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Lemma 2.18. For any predictable correspondence C : f2 — > 2 R \ {0} ; the space 0(C) has 
the following properties: 

1) 0(C) is stable under bifurcation: If$, ip are in 0(C), a is a stopping time, F G T a 
and i9l[o, CT ] = </?l[o,o-], i/ien -0 = + v?1f c ^ s in ©(C). 

2) 0(C) zs almost stable: For all -&,ip in 0(C), stopping times a and F G T a with 
P[F] > 0, there is for each e G (0, P[F\) a set F £ C F in T c with P[F\F e ] < e such that 

if; ■= $i F c + ($t M + <pl hiTl )l Fe is in 0(C) 
and "d % S c is uniformly bounded on F £ . 

Proof. By the definition of 0(C), we must in both cases find a sequence (vjj n ) in 0(C) 

L 2 (P) P 

such that ip n • S T — > ip ' S T and ip n • S T — > ip • S T for all stopping times r. We start 
with approximating sequences and (y? n ) in 0(C) for tp G 0(C). 

1) For ?/> n := $ n !ir + G 0(C), the local character of stochastic integrals yields 

U n -S T - ^-StWl^p) = \\($ n 'S T - $'S T )1 F + (<p n 'S T - <p'St)1f°\\i?{p) ™ 
and, for all stopping times r, 

i(j n .S T = (tf n -S T )l F + {^ n -S T )l F c ^ (#-S T )l F + (<p'S T )l F c = %l)-S T . 

2) By Egorov's theorem, we can find for each e G (0,P[F]) a set F £ G T a with 
P[F \ F £ ] < e such that t?" • S a — > $ • S a and <p n • S a — > tp • S a uniformly on F £ . For the 
sequence vp n := $ n l F c + (i? n l| 0)O .j + ^Ij^j)!^ in 0(C), we obtain again from the local 
character of stochastic integrals that 

\\iP n -S T - (tfl F = + + v i h , n )i FE )-s T \\ L2(p) 

< \\(d n 'S T -d'S T )l F .\\ L 2 {P) + \\^ n 'S a -^'S a )l Fs \\ L 2 {P) 

+ \\(<p n -S ff - ip-S a )l Fs \\ LHP) + \\(p n -S T - <p-S T )l Fe \\ L , (P) ™ 0, 

where the first and the last term on the right-hand side converge to zero by the choice of 
($ n ) and (<p n ) and the two middle terms by the uniform convergence on F £ . Since 

^.S T = (# n -S T )l F c + (# n -S aAT )l Fs + (p n -S T - <p n -S aAT )l Fs , 
lf;.S T = (#-S T )l F c + ($>S aAT )l Fe + (ip-S T - p-S aAT )l Fe 

for all stopping times r again by the local character of stochastic integrals, we obtain that 
p 

if) n, S T — > ifj'S T for all stopping times r. 

Finally, to get $ • S a uniformly bounded on F £ as well, one starts instead of F with 
some F' N := F n • S a \ < N} G T a . Then F' N / F, so P\F' N ] increases to P[F] as 
N — > oo, and taking iV(e) large enough will give the result. This completes the proof. □ 
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3 Dynamic programming 

In this section, we establish a dynamic description of the optimal strategy for ( 12.4ft by 
dynamic programming. To that end, we consider the problem to 

minimise E[\V T (x,$)\ 2 ] = E[\x + $-S T \ 2 ] over all d G 8 (AT) (3.1) 

for a fixed i£R and a predictable correspondence if : Q — > 2 Rd \ {0} with closed cones 
as values. We view (13. ip as a stochastic optimal control problem and want to study the 
corresponding value process. 

We first need some notation. For any stopping time r with values in [0, T], we denote 
by <S T) t the family of all stopping times a with r < o < T (so that r G <?o,t)- in order 
to describe the optimisation starting at time r with wealth x, we define for r G <So,T; 
a G S T , T and $ G 6 (if) with $ = on [0, r] the space 

a; r) := {v? G 9 (if) | c/? = on [0, r] and = } 

= {p e 6(if) | <pl M = 

Note that a; a) = &(0, a; a). We then define for p G cr; r) the random variables 

T(<p,(t;x,t,<&) :=E[\V T (x,<p)\ 2 \F a ] = E[\x + J°$ u dS u + /J p u dS u \ 2 \ JF a ] , 

and for a G S T , T and d G 6 (if) with & = on [0, r] 

J(<t; x, r, ^) := ess inf iYyj, cr; a;, r, #). 

Because the family {T(ip, cr; x,t, $) \ <p G ^(-!9,cr;r)} is stable under taking minima by 
part 1) of Lemma [2. 181 the family {J(a; XjT,^) \ a G S t ,t} for any fixed r G 5o,t is a 
submartingale system for any $ G 6 (if) with •& — on [0, r]. It is a martingale system 
for d G 0(if ) with d = on [0, r] if and only if $ = (p( x ' T > is optimal for the problem to 

minimise E[\x + J T ip u dS u \ 2 ~\ = E[\x + p m St\ 2 ] over all ip G .8(0, r; r). (3.2) 

These facts follow by standard arguments as e.g. in Chapter 1 of [12J or the proof of 
Theorem 4.1 in [21] . We now exploit the quadratic and conic structure of our problem to 
obtain a decomposition of J. 

Proposition 3.1. For any stopping time r G <So,Tj there exist families of random variables 
{^(a) | cr g iS r ,r} such that 

J(a;x,T,$) = ess inf E\\x + r$ u dS u + (J y> u dS u \ 2 \ J"J 

= ((*+ r;^^ u )+) 2 L+(a) + ((x+ r;^d5 u )-) 2 z-(a) (3.3) 

/or an?/ a G iS ri T and an?/ $ G O(if) with $ = on [0,r]. Tne random variables L^^a) 
do not depend on x, r or d and are explicitly given by 

L±(a) := ess inf E[\l ± f p u dS u \ 2 \j r a ] = J(a;±l,a,0). (3.4) 
In particular, all the -^ ± (cr) are [0, l]-valued, and L^iT) = 1. 
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Proof. Fix x, r, d and a and define L ± {o~) by (13.41) . The last assertion is then obvious, and 
the intuition for (13. 3 p is that the quadratic structure of our problem and the fact that the 
constraints are given by cones allow us to pull out an Jv-measurable factor. Note that 
we can also write d • S a instead of J°$ u dS u because $ = on [0,r]. For the detailed 
proof of (13. 3p . we argue by contradiction. Suppose first that 

J{a;x,T,$) < {(x + d-S a ) + ) 2 L + (o-) + {(x + S a )-) 2 L- (a) on F' 

for some set F' G T a with P[F'] > 0. Then there exist (p G a; r) and F G T a with 
F CF' and P[F] > such that 

E[\x + <p-S T \ 2 \F a ] < ((x + $-S a ) + ) 2 L + (a) + ((x + $-S a )-) 2 L~(o-) on F. (3.5) 

Since J(cr; x, r, i?) > 0, we have FC{0<|x + , $*S' (T |} and can write 



+ ((x + tf-^)-) 2 ^ 



1 + 



_ l] g ,rjj¥? 
(X + V-Sr) 



T 



T 



2 



on F. 



(3.6) 



E 



1 ± 



<L ± (a) on F± := Ffl {x + {t>S a ^ 0}. 



Plugging the last expression into (13. 5p . we obtain 
To derive a contradiction to the definition of L ± (a), it remains to show that 



1> 



1 G ± G &(0,o-,a) 



for some sets G ± G T a with G 1 * 1 C F ± and PfG 1 * 1 ] > 0. To that end, let (<p n ) n m be an 
approximating sequence in Q(K) for ip. By passing to a subsequence again indexed by n, 
we can assume that tp n • S a — )■ tp m S a P-a.s. Then we can find G + G with G + C _F + 
and -P[G + ] > such that m > \x + $• S a \ > — on G + for some m G N, by continuity of 
P from below, and (p n, So- — > <p'S a uniformly on G + , by Egorov's theorem. Moreover, we 



obtain that ip r 



-tc+ £ Q(K) because K is cone- valued, and 



\r-s e - *p + >s e \ < (\v n -s e - ^-^i + \ (p n -s a - <p-s ff \)-i& 



m 



for all stopping times g. By the choice of (ip n ) and the local character of stochastic 
integrals, the right-hand side converges to zero in probability for all stopping times g, and 
in L 2 (P) for g = T. Since ip n 'S = = tp + • S on [0,r], we have that ^ + e £(0,a;a). By 
analogous arguments, we can also establish that ip~ £ -&(0, cr; cr). 
To complete the proof of (13. 3p . we now assume that 



i?) > ((x + $'S a ) + ) 2 L + (o-) + ((x + d-S a )-) 2 L- (a) on F 
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for some set F G J- a with P[F] > 0. Then there exist ip + and tp in £(0, a; a), some e > 
and P e G with F £ CF and P[P £ ] > 2e such that 

J(<t;z,t,0) > ((a; + 0-S ff ) + ) 2 E[\l + <p+ • S T \ 2 \T a ] 

+ ((x + $'S a )-) 2 E[\l-<p--S T \ 2 \F (T }+2e onF £ . (3.7) 

By the definition of the essential infimum, there exists if 6 G &(0, a; r) such that 

E[\x + <p £ -S T \ 2 ] <E [J (a- x, r, 0)] + e 2 . (3.8) 

Since {\x + • S a \ < m} /* Q for m — > oo, there exists G £ G T a with G e C F e and 
P [G e ] > e and such that \x + $'S a \ < m on G £ , and therefore 

X := {(x + tf-S a ) + <p + + (x + $>S a )-^-)l G£ e&(0,a;a) 

by the local character of stochastic integrals. Moreover, we can by part 2) of Lemma 12.181 
without loss of generality choose G £ such that ip := <$ e \g% + ($l[o,o-] + x1]<t,ti)1g s is m 
&(0, a; r). Then we use that c/? £ G &(0, cr; r), the definitions of ip and x, and (13.Tj) to write 

> IccPflx + VS'Tl 2 !^] +1 G£ (P[|^ + ^*^ + X*5't| 2 |^] +2e). 

In view of ( }3,8]L the definition of *0 and since P[G e ] > £ and ^ G .£(0, cr;r), we obtain 
after taking expectations that 

E[j{a;x,T,$)} > E[\x+ip £ *S T \ 2 ]-e 2 > E [\x + if; - S T \ 2 } + 2e 2 -e 2 > E[J(a; x,r,tf)]+e 2 
which is a contradiction. So (13. 3p must hold. □ 

Our next result shows that the random variables -^ ± (cr) as well as J (a; x, r, 0) can be 
aggregated into nice RCLL processes. 

Proposition 3.2. 1) There exist RCLL submartingales (Lf)o<t<T, called opportunity 
processes, such that 

L± = L ± ((j) P-a.s. for each a G 5 ,t- (3.9) 

2) Fix x G M. and r G <So,t- Define the RCLL process (Jt('d; x,r))o< t <T for every 
•d G 0(K) with = on [0, r] by 

Jt(0;x,r) = ((x + J*d u dS u ) + ) 2 Lt+ {(x + $l<} u dS u )-) 2 Lt. (3.10) 

Then we have for each G Q(K) with = on [0, r] that 

J CT (0; x, r) = J(a; a;, r, 0) P-a.s. for each a G S t> t- (3-H) 

Moreover, J(0; x, r) is a submartingale for every G O(i^) rt/i = on [0,r], and 

J(0; x, r) is a martingale for G O(i^) wift = on [0, r] z/ and only if ' = ^ X ' T ^> is 
optimal for ( 13. 2 j) . 
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Proof. 1) For r = 0, (L ± (t))o<t<T are submartingales by Proposition 13. 11 They have by 
Theorem VI. 4 in [TOJ RCLL versions if the mappings t h- >■ £'[L ± (t)] are right-continuous. 
We only prove this for L~ as the argument for L + is completely analogous, but argue a 
bit more generally than directly needed. Fix a stopping time a G <S r .r- By (13.41) and the 
definition of the essential infimum, there exists for each e > some d e G £(0, a; a) with 

E[L~(a)] > E[\l-tf £ -S T \ 2 } -e, 



and d e can be chosen in G as the L 2 (P)-closure of Gt{®{K)) contains Gt{&(K)). Let 



(o~ n ) be a sequence in S a ^ with a n \ cr. Then (lj (Jn ,T]] , # £ ) 'S 1 



« 2 (P) 



l]o-,T]^ e ) •5' and thus 



^[l 1 - (l]K,r]tf e )'<Sr| 2 ] ->■ E[\l - (l KrI tf £ )-S r | 2 ] by Theorem IV.5 in [28]. Therefore 
> lim E[\l-(l hn , n tf £ )-S T \ 2 ] -e> lim E[L-(a n )] - e, 

which yields E[L~(a)} > lim £ , [L _ (o"„)] as e > was arbitrary. Conversely, the submar- 

n— >oo 

tingale property of L~ gives _E[L~(a~)] < lim E[L~ (o~ n )], where the limit exists by mono- 

n— >oo 

tonicity. So we get E[L~(o~)] = lim E[L~(a n )}, completing the proof of right-continuity. 

n— »oo 

2) Thanks to step 1), we can take as an RCLL version of (-^ ± (^))o<i<T- To 

prove (13.91) . take a,a n G S T) t such that a n \ a and each a n takes only finitely many 

values. Then ( 13. 9p holds for each cr n and so lim L ± (a n ) = lim = because 

n— >oo n—>oo " 

L are RCLL. Since all processes take values in [0,1], dominated convergence yields 
E[L^} = lim E[L ± (a n )] = E[L ± (a)] by the argument in step 1), and since the sub- 

n— >co 

martingale property, (13.91) for a n and again dominated convergence give 
L ± ( ( j) < lim E[L ± (a n )\j r (J ] = lim = L± 



we obtain (13.91) for a as well. This proves part 2). 

3) The equality in (13.111) follows directly from the definition (13.101) . (13.91) and the 
decomposition H 3 . 3 f) in Proposition 13.11 The properties of the J-family then immediately 
give the remaining assertion in part 2). □ 

The next result gives an alternative description of the processes Iv and some further 
useful properties. 

Lemma 3.3. Suppose that there exists a solution cp( x > T > to (13.21) . Then: 
1) We have the decomposition 



(x,t) 



(3.12) 



2) For any a G <S t ,t ; we have on {V a (x,(p( :c > T ^) ^ 0} that 



E 



1 ± 



(x,t) 



T 



E 



1 ± 



(x,t) 



<S> 



T 
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3) The process T M^ = 1 ]T)T] • with 

M^) ■= (x + ft x ' T) -S) + L + - (x + if {x ' T) - S)~ L- 
is a square-integrable martingale. 

4) If K : Q — > 2 Rd \ {0} is convex-valued, then S)M^ X,T ^ is a submartingale for all 
•d G 0(iT) = on [0,r]. 

Proof. 1) The decomposition f 1 3 . X 2 j) of the optimal strategy is obtained like (13. 6p directly 
from the fact that our optimisation problem is quadratic and the constraints are conic. 

2) If there exists a solution ip( x > T > to (13.21) . we obtain by part 2) of Proposition 13.21 that 
J CT (^ X,T ); x, r) = E[\x + <^ (l ' ,T ) •S , r| 2 |J r CT ] and therefore 

onF:= {^,^ T >)>0}e^ 

by dividing in (13. 31) . For the proof of the second equality, we can assume that the process 
i? := J+y~, x t) . If is in Q(K) by part 2) of Lemma [2. 181 and by possibly shrinking F. 
Then the first equality implies for all e > — 1 that 



#[|l + ((l + e)#)-S T 


2 


7 a ] -E[\l + d>S T 


2 






\e 





= -sign{E)E[(#-S T )(l + #-S T )\F a ) + \e\E[\$'S T \ 2 \F a ]. (3.13) 
Taking hm and hm in (13. 131) yields E[($ • Sr)(l + i? * St^I-Tv] = 0, which implies that 

E[\l + St\ 2 \ Fo\ — E[\ + d • Srl^v] and therefore the second asserted equality. The 
argument for L~ is completely analogous and therefore omitted. 

3) Using the second equalities in part 2), we can write for a G S Tj t that 

E[x + f {x ' r) -S T \ F a ] = (x + f (x ' T) 'S a ) + L+ - (x + ft x ^ - S a y L~ , 

which immediately gives that T M^ = 1] T)T] 'M^' T ) is a square-integrable martingale. 

4) Since $ G Q(K) implies that li?x(s,t]n]T,r]^ is in £(0, r) for all s < t and A G J 7 ,, it 
follows from the first order condition of optimality for (13. 2 j) that 

£[l F ((lj Ti71 tf) - (l ]Ti71 i?) -5 S ) (x + ^ -5 T )] 

= £[((lFxMn] T ,T]^)'5T)(^ + ^ M '5 T )] > 

and therefore that ((l] T ,r|t?) -5t)£?[(x+ ^ (x ' t) •5r)|J r t], < t < T, is a submartingale. □ 

The martingale optimality principle in Proposition 13.21 gives a dynamic description of 
the solution if = only for J{fp\ x, 0) 7^ 0. This can cause problems. But (13 . 10[) shows 
that if J(<p; x, 0) becomes 0, then either V(x, if) = or L + = or L~ = 0. In the latter 
two cases, the payoffs ti L + =0 -i or — lr L - =0 \ with r = inf{t > | Jt{f] x, 0) = 0} A T are 

in GT(©(i^lj Tj yj)), and in the terminology of Section 4 in [30], these random variables 
provide approximate profits in L 2 which is a weak form of arbitrage. So intuitively, we 
have difficulties with describing if only if the basic model allows some kind of arbitrage. 
The next result, which generalises Lemma 3.10 in |4], gives a sufficient condition to prevent 
such problems. 



E 



1 + 



•S- 



T 
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Lemma 3.4. Suppose that there exist N G M.^ Xoc (P) and Z N such that (£,Z N ) with 
£ = £(N) is regular and square-integrable and S is an £-local martingale. Then L ± and 
their left limits L_ are (0, l]-valued. 

Proof. We prove the assertion for L + and LZ by way of contradiction; the completely 
analogous proof for L~ and LZ is omitted. Define r := inf{t > | = 0} A T and 
suppose that P[L+ = 0] > 0. By (pTIj) . fl3T9|) and the definition of r, 

Srfr)^^ 1 + Wl {L + = o} = 4l{i+=o } = 

and so there exists a sequence (i9 n ) in £(0, r; r) such that ((■#"• 5 , t)1{l+ =C) }) converges to 
— 1{ L + =0 | in L 2 (P). Since = 1, we have that 

oo 

{L+ = 0} = {L+ = 0,r < T} = |J{L+ = 0,T m < r < T m+1 } 

m=0 

and hence P[L+ = 0,T m < r < T m+i ] > for some m G No- But each $ n • £ is an 
(£, Z Ar )-martingale by Corollary 12.131 and since Z Fm Tm £(N) is square-integrable, we get 
for every F G T T that 

= }™E[Zl T ~£(N) T (^ -S T )l {Lt=0 ^ T<Tm+i}nF ] 

= - E [ Z T m Tm£ ( N )r^ {L + =0t T m <T<T m+1 }nF] ■ 

Since T ™£(N) ^ on [T m ,T w+1 [, choosing F := { Tm £(A0 T > 0} or F := { Tm £(A0 T < 0} 
gives a contradiction to the assumption that P[L+ = 0] > 0. So we get L + > 0. 

To prove that LZ > 0, define the stopping time a := inf{£ > | Lf_ = 0} A T and 
assume that F^ := {L+_ = 0} has PfFj > 0. Because Tm £(N) ^ on [T m ,T m+1 [ and 

oo 

{L+_ = 0} = = 0,(7 > 0} = |J {L+_ = 0,T m < a < T m+1 }, 

m=0 

there exists some m G No with P[F™' + ] > or P[F™~] > 0, where 

F™>± := ^ n {T m < a < F m+1 } n { Tm ^(iV) CT - ^ 0}. 

We fix m and treat without loss of generality the "+" case so that P[F™ ,+ ] > 0. Setting 
a n := inf{t > | L\ < ^} A T gives cr„, < a and a n a F-a.s. on F^, and defining 

F n m '+ := {0 < L+ < -} n {T m < a n < T m+1 } n { Tm £(N) an > 0} G F CT „ 
yields by the definition of a n that 

1 



E 



ess inf F[|l + ^^T| 2 |F CT Jl Fr . + = E[L^1 F ^ + ] < -P[F^ 
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Thus there exist <p n G £(0, o~ n ; a n ) such that lim E\\l + (p n • St\ 2 1 f ™,+] = 0. This implies 

n— too n 

as above via Corollary 12.131 and the square-integrability of Z^ m Tm S(N) that 

= tL E K T ^Wt(^'5t)%, + ] = - n lim E [Z? m T »£(JV) ffn l^ + ] 



0. 



□ 



This contradicts the fact that P[F™ ,+ ] > so that we must have P[F X 

The lemma below allows us to parametrise the optimal strategy in terms of units of 
wealth. The proof uses the technique in [9], which also appears in [6] and [I]. 

Lemma 3.5. Suppose that L^ 1 and their left limits L_ are (0, l]-valued and that there 
exists a solution ip^ x ' T ^ to (13.21) . Then there exists ip^- x ^ G C(S) such that 

V(x,^ T) ) = x + ^ t) -S = x£(^ t) -S) (3.14) 

and 

Lf = E[\£(^h jt , TV S) T \ 2 \T t ] on { x +fi*rt.St ^ 0}. (3.15) 

Proof. Define the stopping times a n = mf{t > | \V t (x, (p( x > T ^)\ < Jrj} A T for n G N, 
set a = lim a n and F = HneNi' 7 " < &} £ \/°° =1 J : (Tn = T a - and consider the square- 

n— >oo 

integrable martingale M^ X ' T ^ = E[Vr(x, tp( x,T ty\J : t] for t G [0,T]. Lemma [3.31 yields 



r( a V r h2| 



(x,t) 



x + ^-S t ) + L+ - (x + ft*rt-s t )-L; 



for t > r, 

,2 



E[(M^ T) ) 2 \F t ] = {(x + ^-S t ) + yLi+{{x + ^-S t )-yL- fort>r, (3.16) 
and since L ± are (0, l]-valued and a n > r, we get |M^„ | < J^L, |M^' r ^| > on {a n < a}, 



{K 



(x,t) 



0} and t F E[M^ T) \F a _] = 0. Then the martingale property of M (x ' t) , 



conditioning on and using Cauchy-Schwarz and (13 . 1 6[) yields 



1 



{crn<cr} 



E 



M, 



(x,t) 



< E 



< 



(x,t) H>?n«T} 

(x,t) 
T 

m£ t) 



M, 



E 



Mr 



(x,t) 



1 1 
+ — 



Since 



lim l {an<a] t F < lim 



•'o'n 

M<J n «T) 
X 

2 t [an<a} P[F c \ T a . 

i 

1 



T 



(x,t) H<rn<o} 



-Mat 



L- 



l F l {cTn<a} P[F c \F an }2 



l: 



p ILpc 



this gives P[F] - 
Therefore ^ x ^ 



and therefore V-(x, $ {x ' t) ) ^ on [0, a] and V(x, y {x ' r) ) = on {a, Tj. 



~(x,t) 

v (a,y(^ T )) -TC-[[ >' J ] * s we ^ defined and satisfies (I3.14p . Plugging (13. 14|) into 
the equations of part 2) of Lemma 13.31 yields (13 . 15[) and completes the proof. □ 
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4 Local description and structure 



In this section, we use the dynamic characterisation of the solution of ( 13. If) to derive a 
local description for the structure of the optimal strategy. To that end, we first give a local 
description of the underlying processes by their differential semimartingale characteristics. 

As in [15], Theorem II. 2. 34, each IR d - valued semimartingale X has, with respect to 
some truncation function h : IR d — > M. d , the canonical representation 

X = X + X c + A x ' h + h(x) * - v x ) + [x- h(x)} * ij x 

with the jump measure /i x of X and its predictable compensator v x . The quadruple 
(b x , c x , F x , B) of differential characteristics of X then consists of a predictable Revalued 
process b x , a predictable nonnegative-definite symmetric matrix- valued process c x , a 
predictable process F x with values in the set of Levy measures on IR d , and a predictable 
increasing RCLL process B null at zero such that 

A x > h = b x -B, (X c ) = c x -B, v x = F x -B. 

We use the same predictable process B for all the finitely many semimartingales appearing 
in this paper, and since they are all special, we can and do always work with the (otherwise 
forbidden) truncation function h(x) = x, which simplifies computations considerably. We 
then write A x instead of A x,h . For two (special) semimartingales X and Y, we denote 
their joint differential characteristics by 

c x,y F x,y B) = ((£),( f x C J ),F X > Y ,B 

By adding t to B, we can assume that B is strictly increasing. Recall that Pb = P <E> B. 
For the locally square-integrable semimartingale S, there exists by Proposition II. 2. 29 
in [15] a predictable nonnegative-definite symmetric matrix-valued process c such that 
(M) = c M 'B, and it is given by c M = c s + / xx T F s (dx) - b s (b s ) T AB. 

To prepare for the local description of the optimal strategy, we need some notation. 
For two [0, l]-valued (hence special) semimartingales £ + and £~, we look at their joint 
differential characteristics with S and define the predictable functions 

A 1 '*^) := q^^-SJ+J-) :=£^ T c s ^±2£±i) T b s ±2^j T c se± , (4.1) 

tf^):=Q^-S,l + ,t) :=£ j {{(l±Vu) + } 2 -lT2ii T u)F s (du) 

+ J {{(l±i; T u) + } 2 -l)yF s ' e± (du,dy) 

+ j { ^u r] \£l + Z )FS^du^ (4.2) 

± (^) := s ± (^; S, £ + ,n := g 1 '^; S, £ + , r) + g 2 ^^; S, £+, fr ). (4.3) 

All these functions have ip G W 1 as arguments and depend on u,t via if_(co) and the 
joint characteristics of S and £ ± . For ease of notation, we shall drop in the proofs all 
superscripts T , writing xy instead of x T y for the scalar product of two vectors x, y. 
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Our first main result is now a local description of the optimal strategy tp for (13. ip . It 
is obtained by examining the drift rate of J($), as follows. Recall that the constraints are 
given by a predictable correspondence K with closed cones as values. 

Theorem 4.1. For each d G Q(K), define a K -valued predictable process ip via 

ip ■= M v -(^°} Wj^\\ + V-(^)=o}^ (4.4) 

or equivalently 

=: V+(x, 0)4 + V~(x, T?)V> + 1{VL(^)=0}V- 

Then: 

1) The finite variation part of J($) is given 6j/A(i?) = b J ^-B with 

b m = ^)) 2 { s +(^ ; s, e + , r) + b e+ } + (v-(x, ^)) 2 {q-(^, s, e + , r) + \F } 

+ V-(^)=o}( J (^ T u) + )\£t + y)F s ' £+ (d Ul dy) + £Z^ T c s tP 

+ / r „)f( (: + ^-(*, t ))>o. 

2) If there exists a solution tp = (p( x <ty g B(K) to problem ( 13. ip mtt i/ie property that 

V(x,<p) = x + (p'S = x£(ip'S), 
then the joint differential characteristics of (S, L + , L~~) satisfy the two coupled equations 

b L± = -ming^; S, L + ,L-) = -fl ± (±^;S', L+L") on {Vl(x, ^ 0}. (4.5) 

Proof. 1) Since J(i9) is given by fl3TT0|) . finding its drift rate b JW is a straightforward, but 
lengthy computation; this is done in Lemma I5T21 below. Then b J ^ is nonnegative because 
J{"&) is a submartingale by the martingale optimality principle in Proposition 13 .21 
2) The basic idea to prove the first equality is (as usual) to assume that the set 

D := {(u,t) \b L+ > -ming + (i(j;S,L + ,L-)} n {x£$'S)- > 0} 

has Pb{D) > and then to construct from D via measurable selection a strategy $ in 
Q(K) which violates the submartingale property of J(i?). This simple idea is technically 
a bit involved because one must ensure that *& is iT-admissible and that there exists a set 
D' G V with D' C D, P B (D') > and V_(a;,0) > on £>'. The details are as follows. 

Since V(x,(p) = x£(ip'S) is a stochastic exponential, it changes sign only at jumps 
with ipAS < —1, which P-a.s. can only happen a finite number of times. So there exist 
stopping times T\ < r 2 such that Pb(D njrj, r 2 ]) > and x£(ip m S)- > on ]ti,t 2 ]. 

By part 2) of Lemma 12.181 we can choose F e G J r Tl such that £>l[o. CTl ] G &(K) and 
(x + ^ • So-Jl^ > is uniformly bounded and D £ := Dn]o"i, cr 2 ] has Pb(D £ ) > 0, 
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where <Tj := 7*1^ + Ttpc for % = 1,2 are stopping times. Because g + is a Caratheodory 
function by Lemma [5711 below and K is a predictable correspondence, we can construct by 
Propositions 12.51 and 12.41 a K- valued predictable process ip with g + (<p) < —b L+ on D £ and 
g + (ip) = else. After possibly shrinking D £ , we can also assume without loss of generality 
that (p is bounded, which implies that (p is in C(S) so that (p*S is well defined and has 
P-a.s. only a finite number of jumps with tpAS < — 1. Thus there exists stopping times 
£?i < £2 such that D' := D e n}gi, £> 2 ] has P B (D') > and £(tp'S)- > on J^, £> 2 ], where 
ip := V^ljei.^l- By stopping £(ijj'S)- and 5*, we can even choose g 2 such that £{tp'S)^ 
is bounded and £(vfj • S)-ip E 0(i^); this uses that K is cone-valued. Moreover, since 
(x + (p m S ai )ljp e is bounded, also (x+ Lp' S^tp^i^)' S)-tp is in Q(K). Therefore the sum 

:= (pl[Q^\ + (x + (p'S ai )t Fs £(ip'S)-ip 

is in Q(K) and has (x + • 5)_ > and ) = +(^) < -6 L+ on D'. In 

view of part 1), 1 D , • A{$) = (l D >b J ^) • B = (l D ,(x + • S)-{g + (ip) + b L+ }) • B is 
strictly decreasing on a non- negligible set, and so </($) cannot be a submartingale. This 
contradicts the martingale optimality principle and thus establishes the equality for b L+ . 
The argument for b L is completely analogous and therefore omitted. □ 

To explain the significance as well as the limitations of Theorem 14.14 let us suppose 
that we have an optimal strategy ip for problem (13. ip . Then part 2) of Theorem 14 . 1 1 gives a 
kind of BSDE description for the pair (L + , L~) since it expresses their drift rates in terms 
of their joint semimartingale characteristics with S. However, this description is not yet 
fully informative on its own. A closer look at (14. 5 p shows that we only have a description 
of the drift of L + (or L~) when V-(x,(p) is positive (or negative). Once V(x,<p) hits 0, 
it stays there, being a stochastic exponential, and we can no longer tell how behave. 
Even worse, V(x, <p) might jump across so that we immediately lose track of the drift of 
L + or L~, depending on whether the jump goes downwards or upwards. To overcome this 
difficulty and obtain a full characterisation of L^, we must be able to "restart V(x,(p) 
whenever it jumps across or to 0". This can be achieved by assuming that not only ( 13.11) . 
but each problem (13.21) for x and r has a solution. This key insight can be traced back to 
Cerny and Kallsen j3]. 

The second condition we need to get a description of L 1 * 1 is that these processes as well 
as their left limits are strictly positive. As already explained before Lemma I3.4[ this can 
be interpreted as a kind of absence-of- arbitrage condition. In fact, if - as in [1] - there 
exists an equivalent local martingale measure for S with density in L 2 (P), that condition 
is automatically satisfied; a slightly more general result is given in Lemma 13.41 above. For 
the case without constraints, we provide a sharp result in Theorem 16.21 below. 

Corollary 4.2. Suppose that Lr 11 and their left limits Lrt are all (0, l]-valued and that 
there exists a solution p( x ' T ^ to (13. 2p for any x E R and any stopping time t. Then the 
joint differential characteristics of (S, L + , L~) satisfy 

b L+ = - mm g + (ijj;S,L + ,L-) and b L = — ming~(-0; S, L + , L~). (4.6) 
Moreover, for all x el and all stopping times r, there exists a solution to the SDE 

dV^ = ((v£' T) ) + # + (l£' T) )-?r) 1]^] dSt, Vt r) = = x (4.7) 
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C(S), and we have 



with -0 ± £ argmin0 ± (-0; 5", L+,L ) on {VT' rJ ^ 0}fl]r, TJ and ^l^t^ri^^^q in 



^r) = ( (V _(-.r) )+V ,+ + (y^-))-^-) 1]T>T] . (4 . { 



iVoie t/iat ^ are noi t/ie positive and negative parts of the process i/j from Theorem 



Proof. By Lemma [3.5[ we have V(x, (p( x > T >) = x S) for some V> (a; ' T) e £(5) with 

V>' t) = ^ (:r ' r) l] rirI so that := V^l^^o^))^} are in C(S) and yield @2D with 
y(x,T) - = V(x,^ x ' T )). Moreover, (|4.5p in Theorem 14.11 shows that ■0 ± are minimisers 
for g 1 * 1 on ^ :C,T ^) ^ 0}D]r,T], and finally (14.81) holds by construction because 

y(x,r) = yfo ~(z,t)) =x + ~{x,t) . ^ Q 

Remark 4.3. For the purpose of constructing an optimal strategy, the result in Corollary 
14.21 is not yet optimal. Ideally, one would like to take any minimisers ifj ± for q^ 1 , solve the 
SDE (14. 7p and obtain that <p( x > T ') defined by ( 14. 8 p is optimal. However, it is not obvious 

whether these ^ ± are automatically in C(S). (That would of course imply solvability of 
( 14 .7p . and even optimality of tp^^ if that strategy is i^-admissible.) 

Before we proceed with our BSDE descriptions, let us briefly return to the classical 
(but constrained) Markowitz problem in (12.21) . For given initial wealth x and target mean 

m, we know from Lemma 12.11 that the optimal strategy is given by •§^ m ' x > = gjpjjh <p, 
where <p = solves (13. 2p for x = — 1, r = 0. To express $( m > x ) in feedback form, write 

?< * m) > = x + ^k<y<- i < ® + J ) = a + w^k v ^ ?) (4J) 

with 

m — x m — xE[l — if • St] 



m := x + 



E[(P'St] E[<f m St] 

By Corollary KM we have ^ ( " 1 ' 0) = (yi~ 1,0) ) + ^+ + (vi~ 1,0) )-^r and therefore 

by plugging in for = V(-l, from (|Q)| . This shows that tf (m ' x) is indeed a state 

feedback control, and it also makes it clear that the critical level for switching between the 
"positive and negative case strategies" ip + and is not zero (as one might think from 
the appearance of positive and negative parts), but rather in. 

Having found in Theorem 14.11 and Corollary 14.21 necessary conditions for optimality, 
we now turn to sufficient ones. 

Theorem 4.4 (Verification theorem). Let £ be semimartingales such that 
1) and their left limits £^ are all (0, l]-valued and 1^,-1. 
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2) The joint differential characteristics of (S,£ + ,£ ) satisfy 

b £+ = -mm Q + (ip;S,£ + , £~) and b l ~ = - mmg-(ip; S, £ + , t). (4.10) 

3) The solution to the SDE 

dV t = (V+& + V~J;)dS t , V = x (4.11) 
with ip^ G argming ± ('0) on {V- ^ 0} exists and satisfies that 



<p ■= V+ip + + V~ip- G Q{K). (4.12) 

Then (p := (p is the solution to (13.1 1) . In particular, (V + ) 2 £ + + (V~) 2 £~ is of class (D). 

To better explain the significance of our results, let us rewrite the drift descriptions 
(14. 6 p and (14. 10 j) into a BSDE as follows. Consider the pair of coupled backward equations 

t = - inf d ± {^;S,£ + ,r)'B + H e± -S c + W i± * {p s - u s ) + N l± , £% = \, (4.13) 

ipEK 

where a solution is a tuple (£ ± , H £ , W e± , N l± ) satisfying suitable properties; see below 
for a more precise formulation. Then Corollary 14.21 says that the opportunity processes 
L ± from ( 13. 9 p satisfy the BSDE system ( I4.13p . and Theorem 14.41 conversely allows us to 
construct from a solution to (14. 13|) a solution to the basic problem ( 13. ip . if the natural 
candidate strategy (p from (14.121) has sufficiently good properties. 

Remark 4.5. More generally, we could use Theorem 14.41 to construct solutions to (13. 2p 
for any x G R and stopping time r. Indeed, if we replace the SDE ( 14.1 ip with ( 14. 7p . the 
definition of p in ( 14 . 1 2 1) by (14. 8[) and assume that <p^ x > T ^ is in Q(K), then <p( x > T ) is the 
solution to ( 13. 2p . The argument is exactly the same as below for problem (13. ip . 



Proof of Theorem\l4\ For ■& G Q(K), define = (V + (x, d)f£ + + (V~(x, d)f£- and a 



if-valued predictable process ip by ( 14.41) so that t? = V*(x, $)ip+V~ (x, r &) r ip+1{v_(x,-a)=o}ip ■ 
If $ G Q(K), then sup 0<t<T |V£(a;,#)| G L 2 (P). Since t are (0, 1]- valued, we then have 
sup 0<t<T |it(^)| G L X (P) and so j{d) is a special semimartingale with canonical decom- 
position = j {&) + + Lemma [El below gives A>W = V^'B with 

V m = W = (V+(x, ^)) 2 {fl + (^ S, £ + , £- ) + b e+ } + (V~(x, $)) 2 {g-(ip; S, £ + , t~ ) + b e ~} 

+ l{v_(M)=o}( J ({i)u) + )\£t + y)F s > l+ {du,dy)+r_ipc s ip 

+ J ((iPu)-)\£z + z)F s ^(du,dz)y 

Since W > by the BSDE (14. lOj) in 2) and because £ are nonnegative, is therefore 
a submartingale, and using |Vr(x, i?)| 2 = jr(^) due to ^ = 1 gives 

E[\V T (x,#)\ 2 ] >E[(x + ) 2 £+ + (*-)%}■ (4-14) 
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Because $ G Q(K) was arbitrary and the closure in L 2 of Gt{0{K)) contains Gt{®{K)), 
by definition, (I4.14p extends to all i? G 6(iT). 

To show that (p is optimal, we want to argue that j(0) is a super martingale, since 
we then get the reverse inequality in (I4.14p which is enough to conclude. Because (p is 
only in Q(K), however, we do not know a priori if j((p) is special and thus must localise 
as in Lemma 15.21 So we define for each n G N the set D n :— {\<p\ < n} £ V and 
X n := l Dn >j{(p) = j n (ip). We first note that (jU2D and fl4TTT|) imply that V = V(x, (p). 
The SDE (14.111) then implies that V remains at after V- hits zero, and so ipl^v-=o} = 
by (I4.12p . For Tp defined from (p via (I4.4p or ( 15.1 \ in Lemma [5.21 below, we then get 

$ = <p = on {V- = 0} = (p) = 0} 

and therefore from (I5.2p below that 

W= {v^{x^))\Q + {^SA + A-) + b t+ } + {v:{x^)) 2 {Q-{^s,tA-) + b"'}. 

But (I4.4p also gives that Cp = V*(x, (p)t[) + V~(x, (pjxp = V^tfj + V~vJj, and comparing this 
to (I4.12P shows that 

tjj = on {V- > 0} and 4> — ip~ on {V- < 0}. 

Because ip ± are minimisers for q ± , we obtain that \P = 0. 

Now each X n is by Lemma loT2l below and the above argument a special semimartingale 
with finite variation part A x " = A jn &) = V n &) >B = (l Dn W)'B = 0. So each X n is a 
local martingale, which means that j((p) is a cr- martingale. Since > 0, it is therefore 
a supermartingale and so <p solves (13. ip . By part 2) of Proposition 13. 2^ j[(p) is then even 
a martingale on [0, T] and hence in particular of class (D). □ 

We now return to the formulation of the equations (14.61) or (I4.10p as a coupled system 
of BSDEs. We first recall that by Proposition II. 2. 29 and Lemma III. 4. 24 in [15J, any 
special semimartingale £ can be decomposed as 

£ = A e + H i -S c + W e *{n s -is s ) + N e (4.15) 

with H e G Lf oc (S c ) : W e G G loc (/i) and N* G M ,ioc(-P) such that (S c , (N e ) c ) = and 
M^AN^T) = 0. Then 

A£ = AA £ + {W t - W e )l {As ^o} + AiV £ 

and therefore 

P (A£AS) = [ (AA l + (W e (u) - W e ))uF s (du). (4.16) 
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This allows us to rewrite the functions g 1 * 1 from (I4.ip - fl4.3p as 

Q ± {ifj; S, £ + , r) = £^ T c s if; ± 2£±if) T b s ± 2ip T c s H e± 



+ J ({(l±^ T u)+} 2 -1)(AA £± +W i± (u)-W r± )F s (du) 
+ J {(l + i/j T uy} 2 (£f + AA eT +W^(u)-W^)F s (di 



=:h ± (^;5,£ + ,r). (4.17) 
We now consider the coupled system of backward equations 

£ ± = - inf ^ty, S, £+,£-)• B + H** • S c + VP** *(jjl s -V s ) +N* k , 4 = 1. (4.18) 

A solution of (14381) consists of tuples # £± , W £± , iV €± ) such that H l± are in LL(S C )> 
W/ £± are in G loc (/i), iV £± are in M 0tloc (P) with (S c , (iV £± ) c ) = and M^(AN f± \V) = 0, 
and £^ are (special) semimartingales with values in [0, 1]. Moreover, being a solution also 
includes the condition that inf f) ± ('0; S, £ + , £~) are finite-valued processes. For brevity, 

tp&K 

we sometimes call only (£ + ,£~) a solution. Then Corollary 14.21 can be restated as 

Corollary 4.6. Suppose that Is* 1 and their left limits L_ are all (0, l]-valued and that there 
exists a solution to (13.21) for any x G K and any stopping time r. Then the opportunity 
processes satisfy the coupled BSDE system 

L± = - inf i) ± {^;S,L + ,L-)'B + H L± 'S c + W L± *{fi s -u s ) + N L± , L% = 1. (4.19) 

Moreover, there exist K -valued processes ip^ such that 

S, L + , L-) = inf h^; S, L+, IT). 

The result in Corollary 14. 61 can be viewed as giving existence of a solution to the BSDE 
system (I4.18p . and so it is natural to ask about uniqueness. For the case of an Ito process 
5* in a Brownian filtration, Hu and Zhou [13J obtain a uniqueness result in the class of 
those solutions which have both £ ± uniformly bounded away from 0. However, this also 
rests on very restrictive assumptions on the Ito coefficients of S (uniformly bounded drift 
and uniformly elliptic volatility matrix), and one should not expect to have uniqueness in 
general. In fact, one can deduce from Example 3.26 in pE] and the counterexample in [5] 
that the opportunity processes L ± are not the only solution to the BSDE system (14.181) . 
not even in the unconstrained case and if 5" is continuous and under uniform integrability 
assumptions. Nevertheless, there is a positive result, motivated by similar ones in [27]: It 
turns out that L are the maximal processes which satisfy (14.181) . 

Lemma 4.7. The opportunity processes L^ 1 satisfy > £^ for any solution (£ + ,£r) of 
the BSDE (14.181) . In particular, under the assumptions of Corollary \4-%\ {L + , L~) is the 
maximal solution of (I4.18p . 
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Proof. This argument only uses the definitions of L in (13. 9p and (13.41) as essential infima. 
Let be any solution to (OBI and define r := inf{t > | # > L+} A T. By 

(13T9|) . there exists a sequence ($ n ) in ®{Kl hn ) such that lim £7[|V^(1, ^ n )\ 2 \J r T ] = L+ 

n— >oo 

P-a.s. The same argument as in the proof of Lemma 15.21 then shows that the process 
j($ n ) = "!? n )) 2 ^ + + (V~(l, ■d n )) 2 (r is a submartingale, and so we obtain from = 1 

and V T (l,i? n ) = 1 that 

C < lim E\\V T {l^ n )\ 2 \7 T ] = L+. 

By the definition of r, this implies that P[r < T] = and therefore that L + > £ + P-a.s. 
The proof of L~ > £~ P-a.s. is analogous and therefore omitted. □ 

Remark 4.8. Due to the coupling term coming from f} 1 * 1 , the BSDE system (14. 18ft is 
very complicated. It has a nonlinear non-Lipschitz generator plus a driver with jumps, 
so that finding a solution by general BSDE techniques seems a formidable challenge. It 
is fortunate (and inherent to our approach) that we do not need to tackle this issue. We 
exploit instead that ( 14.19P is intimately related to a stochastic control problem and prove 
directly existence of a solution to the latter, which then yields existence of a solution to 
(I4.19p . In that sense, we use BSDEs not for their own sake, but only as a tool to describe 
the value process of our stochastic control problem. 



5 Proofs 

This section contains the more technical proofs. Several results and computations do not 
use the precise definition (I3.9P of the processes L^, but only some of their properties. 
To emphasise this, we formulate the corresponding results here for generic processes £ ± . 
Recall that we drop the superscript T in all proofs. 

We first show that the predictable functions in (14. II) - (14. 3 1) are well defined and have 
nice properties. 

Lemma 5.1. Let be two [0, l]-valued semimartingales. Then the predictable functions 
fl 1 '*; 2,± and q ± defined in (14. II) - (14. 3p are Caratheodory functions, which are convex and 
continuously differentiable in ip with 

Vg 1 '^) = 2£^c s if; ± 2iH s ± 2c Si± , 

V S 2 ' ± (^)=2^y ((l±ip T u) + u-u)F s {du)±2 J(l±^ T u) + uyF s ' e± (d Ul dy) 

Proof. We only prove the assertion for q 2, ~ as the arguments for the other functions are 
completely analogous or obvious. So we write q 2 ~ as 



Q 2 >-(ij;S,e + ,r)=ez I f 1 ^,u)F s (du)+ I f 2 ^,u,y)F s ^(du,dy) 
+ / (f 3 ty,u)e± + U(il>,u,z))F s ^(du,dz) 
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with 



/ 1 (^,u) = {(l-V«) + } 2 -l + 2^« > 
f2W,u,y) = {{(l-^u) + } 2 -l)y, 
f^,u) = {(l-4>u)-}\ 

f 4 (ip,u,z) = {(i -ipuy} 2 z. 

Since S G H 2 oc (P) and the jumps of £ ± are bounded by 1, we obtain that J \u\ 2 F s \du) , 
/ \u\ 2 \y\F s ' e ~ (du, dy), f \u\ 2 \y\ 2 F s > e ~ (du,dy) and j \u\ 2 \z\F s ' e+ (du,dz) are finite. Com- 
bining this with the estimates 

\fx(ip,u)\ = |?H 2 l«m<i} + |2^m- l|l{v-u>i} < 2H 2 M 2 , 
|/2(^, «,y)| = |(0«) 2 - 2ipu)yl {i , u <i } - yl {i>u>1} \ < |^| 2 M 2 (M + |?/| 2 ), 

|/ 3 foM)l = |Vm-i| 2 i { ^<i } < M 2 M 2 , 

\U(if> t u t z)\ = \ipu- l| 2 |z|l {v , u <i} < |^| 2 |w| 2 |z| 

gives that q 2 ~ is finite-valued for all G Mr. The convexity of g 2 ' - then follows imme- 
diately from the convexity of fx, . . . , f± in if). To verify the continuous differentiability of 
g 2 ' - , we want to differentiate under the integrals via an appeal to dominated convergence. 
To that end, we fix ijj G M. d , take an open ball B e (tp) of radius e > around ip and 
estimate for £ G B e (ip) the partial derivatives 

|V^/i(£,u)| = I - 2(1 - £u) + u + 2u\ < 2|£tm|l {€ «<i } + 2|w|% il>1} 

< 2(|^| + e)\u\ 2 + 2\u\t< H> ^ < 4(|V| + e)\u\ 2 =: h(u), 

|V^/ 2 (e,«,2/)| = I " 2(1 -iu) + uy\ = 2|e«||«||yH ff „<i } < 2(H +*| 2 |?/| =: 

|V^/ 3 (e,«)| = |2(1 - = 2|1 - ^||«|ltt«<i} < 2(|V| + e)M 2 =: ft 3 («), 

|V^/4(^,w,^)| = |2(1 -£u)~uz\ = 2 1 1 - fw|% w <i}|«||2| =: h 4 (u,z). 

Since hi, . . . , /14 are all integrable, we may indeed interchange differentiation and integra- 
tion, and so q 2 ~ is continuously different iable in ip. In particular, g 2 ' - is continuous in ip 
and a Caratheodory function. □ 

We next want to compute the drift of J($) for Theorem 14.11 Note below that the 
superscripts ± for £ only serve as indices; they do not denote positive and negative parts, 
unlike V ± (x, #). While this notation may be slightly ambiguous, we found too heavy. 

Lemma 5.2. Let be [0, l]-valued semimartingales and set 

■= (\/ + (x,^))V + (V'ix^fr. 

For each $ G 0(-K"), we define the K -valued predictable process if) as in ( 14. 4 p wa 

=: y_+(x,^)^ + Vl{x,$)i) + l {v _ (M)= o } ^. (5.1) 
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Then j n ('i9) := 1d„ ' is a special semimartingale for each D n := < n} G V 
and n e N. In the canonical decomposition j n ($) = io(^) + + ^'"W, we /iave 

&«= (y + (a;^)) 2 { + (^^£ + ,r) + fo £+ } + (lC(x^)) 2 { -(^5,£ + ,r) + r} 

+ 1{vl(x,*)=o}( y ((^ T «) + ) 2 (^ + y)^ + (^,^) + C^ T ^ 

+ / ((V T u)-) 2 (C + «)^"(d«,^)). (5.2) 
If is special, then W^' = W . 

Proof. The Meyer-Ito formula (Theorem IV. 71 in [28]) and integration by parts give 

d(V + (x,$)) 2 = 2V+(x,0)tidS+ l {v _( x ,v) >0 }tfd[S c ]tf + A(V + {x,tf)) 2 - 2V+(x, 

(x, i?)) 2 = -2VT (a;, dS + (*,*)<o}0 d^tf + A (V~ (x, ■&)) 2 + 2 VT (a;, tf)??AS 

and 

lD„d{£ + (y+(x,^)) 2 } = l Dn (V+(x,$)) 2 d£ + + l D Jt(2V+(x,$)$dS 

+ V-(^)>o}M^ + {A(V + (x,$)) 2 - 2V+(x,$)$AS}^ 
+ 21 Dn V+(x,^d[S c ,(£ + ) c ] + l Dn A(V+(x,'d)) 2 Al + , (5.3) 

i D j{£- (v-(x, #)) 2 } = i Cn #)) 2 dr + i Dn r ( - 2Kr(z, 0)# dS 

+ l{^(^)<o}^dm^+{A(^(^^)) 2 + 2Vr(x,^)^A5}) 
- 21 Ai yj(a;^)^d[5 c , (r) c ] + l „A(r(x,i5)) 2 At. (5.4) 

Since AV(x, •&) = $AS, S is in Hy oc (P), \ A£^\ < 1 and i? is bounded on D n , the supremum 
of the jumps of each term in (I5.3P and (15.4)) is locally integrable. So Theorem III. 36 in 
[2"5] implies that these terms are all special and we can calculate their compensators as 

i Dn '{£ + (V + (x,#)) 2 } 

m ^ rt l Dn (V+(x,0)) 2 -A* + (l Dn et)-((2V±(x,m-A s + l { v^)>oy[#'S c }) 
+ l Dn et{((V-(x,-&)+-du) + ) 2 - (V+(x,#)) 2 - 2V+{x,-ff)$u} * v s 
+ l Dn {((V4x,#)+tiu) + ) 2 - (V±{x,#)) 2 }y *v s ' l+ + 2I Dn V±(x,#)'[#-S c ,{e + ) c ), 

iD»-{r(v-{x,#)) 2 } 

m = t Dn {Vl{x^)) 2 'A r + (WD - ( - (2Vl(x,<&)0)-A s + l { v^)<o}'[^'S c }) 

+ l D Jz{((VL(x,ti) +$u)-) 2 - (Vl-(x,ti)) 2 + 2V-(x,-d)tiu} *v s 

+ l Dn {((V-(x,#)+# U )-) 2 - (VZ-(x,#)) 2 }z*v s < e ~ -2l Dn Vl-(x,#)'[&'S c ,(£-) c }, 
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where we denote by m = t equality up to a local martingale. Adding both equations and 
passing to differential characteristics gives 

A™ = l Dn (l {v ^)> 0} £t$c s $ + 2V+(x, $)$(£ + _b s + c s ' e+ ) + (V+(x, d)fb l+ 
+ it J { [{V . {X , ,) + ft,)*)' - (Vt( X , *))' - 2Vt M] F^u) 

+ J + du) + ) 2 - (V+{x,'&)) 2 }yF s ' i+ {du,dy) 

+ V-(M)<o}» 5 tf ~ 2VZ(x,$)$(£Zb s + c s ^) + (VZ(x,#)) 2 b*~ 

+ cj {((y_(x,#) + tfw)~) 2 - (vr(x,^)) 2 + 2yr(x,^)^}F 5 (rf M ) 
+ /((,KM )+fc) -)'-(r(M))')^(^„). B . 

By plugging in (15. ip . we obtain first 
((VL(x, 0) + ^u) ± ) 2 - (Vf (x, tf)) 2 

= (K ± (x, 1 ?)) 2 {((l ± ^) + ) 2 - 1} + (^^)) 2 ((lTHf + V-M)^}^)*) 2 
and therefore also A 3 '"^ = (Id^) •_£> with 
W = (V+(z,tf)) 2 {£tyc s ^ + 2^(£+6 5 + c se+ ) + b e+ 

+ £±J {((l + ifm) + ) 2 -l-2ij U }F s (du) + J {((l + ^)+) 2 -l}yF s ' i+ (du,dy) 

+ J ({l + im)-) 2 {£Z + z)F s < £ ~{du,dz) 
+ (KT(x,^)) 2 {r^c s ^ - 2^(0 5 + c^") + 6*~ 

+ £zj {({l-i>u) + ) 2 -l + 2^u}F s {du)+ [ {((l-^u) + ) 2 -l}zF s ' e ~(du,dz) 
+ J {(l-^u)-) 2 (£t + y)F s ' i+ (du,dy) 

+ %_(M)=o } { / ((^) + ) 2 (^ + y)^ + (^,^) 
+ r^ c 5 ^ + y ((^)-) 2 (r + 

after collecting terms. The assertion then follows by inserting the definitions of g ± . □ 

6 Related work 

To round off the paper and put our contribution into perspective, we finally discuss the 
connections of our work to the existing literature. This naturally splits in two parts. 
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6.1 The unconstrained case 



For (semimartingale) models without constraints, one key motivation to study the Marko- 
witz problem has been the mean- variance hedging problem (12. 5p . The solution of ( 12 ,5p , for 
an arbitrary payoff H, can be described more explicitly if one knows the variance-optimal 
martingale measure or the opportunity-neutral measure; see for example Theorem 4.6 
in [30] and Theorem 4.10 in [4]. Finding those measures is intimately linked to the 
approximation in L 2 (P) of the constant 1 by stochastic integrals of S, i.e. to (12. 4p . While 
there is a vast literature on mean-variance hedging, the most general results for these 
problems without constraints have been obtained by Cerny and Kallsen [4], and their 
work has also provided a lot of inspiration for our approach. We now quickly explain how 
the main results of [4] can be obtained directly as special cases of our setting. 

Suppose that there are no constraints so that C = K = M, d . The first key simplification 
is then that the opportunity processes agree so that we can write L := L + = L . One 
way to see this is to look at the proof of Proposition 13 . 1 1 and note there that the distinction 
according to the sign of x+d'S^ becomes superfluous since K is symmetric. Alternatively, 
one can look at the definitions of -^ ± (cr) in (13 .4p and observe that they agree for + and — 
because ^(0, a; a) contains with ip also — (p. Again this only needs that K is a cone and 
symmetric around 0, but we shall exploit K = M. d later. Recall that = 0(R d ). 

To get good properties for the (single) opportunity process L, we next suppose as in [4] 
that there exists an equivalent a- martingale measure (EcrMM) Q for S with ^ e L 2 (P). 
(Because S G H\ oc (P), we then have that sup 0<t<Tn \S t \ G L l (Q) so that Q is actually 
an equivalent local martingale measure (ELMM) for S.) Lemma 13.41 then tells us that 
both L and L_ are strictly positive; this recovers Lemma 3.10 from [4J. A substantial 
sharpening is given in Theorem 16.21 below. 

Moving on to the local description in Section HJ we see from L + = L~ = L that we 
only need to consider a setting with £ + = t~ =: £. Then (14. 2 p reduces to 



fl 2 '+(^) =£_ ((1 + ^j T u) 2 - 1 - 2ip T u)F s (du) + / ((1 + tp T u) 2 - l)yF s >\du, dy) 




and therefore f!4.3j) yields 



+(^) = £_^ c s t\) + 2i_i) T b s + 2*p T c se + g 2 ' + (V0 = 0~(-VO- 



If in addition £_ is strictly positive, we can rewrite this as 



+ W 



£_(^ T c^ + 2^ T fe) =fT(-0) 



with 



c:= c(S, £) 



b:=b{S,£) 




(6.1) 



(6.2) 
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as in (3.25) and (3.23) in [3]. So are quadratic functions and we can easily, by comple- 
ting squares, find their minimisers and minimal values in explicit form. The result is 

min Q + (ip) = g + (^ + ) = -^_& T (c) _1 6 = min g-(i(A = (6.3) 

with 

^ + = -V'" =:ip = -(c) -1 & =: -a, (6.4) 

where (c) _1 denotes the Moore-Penrose pseudoinverse of c. We remark that this is well 
defined whenever a minimiser exists, hence in particular if there is an optimal strategy. 
Under the assumption (made in [4]) that there is an EctMM Q for S with g e ^ 2 (P), 

Theorem 2.16 for C = M. d tells us that G T (&) is closed in L 2 (P). The same is true for 

G T (01 ]T , T] ) = G T (0(R d l ]T , T] )) 

for any stopping time r, and so (13 .2p has a solution Lp( x < T "> for every pair (x, r). Corollary 
14.21 thus allows us to identify tp^ x ' T ^; indeed, -0 + = — ip~ = ip reduces the SDE (14.71) to 

whose solution is of course 

= x£(fil lT>Tl )'S) = x£((-al lT>n )'S), 

and so (14. 8 p yields 

^,r) = V^jlyrn = -x 8 ((-al lTiT1 ) • S) _al, T ,r, • (6.5) 

This recovers Lemma 3.7 from [1]. 

One major simplification in the unconstrained case is that we no longer need to dis- 
tinguish between the cases V-(x,<p) > and VL.(x,<p) < because there is only one 
opportunity process L. In terms of the discussion before Corollary 14. 2^ we no longer need 
to worry about jumps of V(x, tp) across since these do not affect the description of L. 
All we need is to be able to "restart V(x, <p) when it jumps to 0", which is the important 
insight obtained by Cerny and Kallsen [1]. The adjustment process a from [4] is moreover 
seen to be given by a = a = — (c) _1 6 = —ip, by comparing (16. 5p to (3.12) in |4]. 

The above result highlights an important difference between our approach and that 
in [1]. We obtain our results by systematically using stochastic control ideas and in 
particular the martingale optimality principle (MOP). To illustrate this with an example, 

we see from the above that a = —ip is obtained as the minimiser of the function q, which 
means that we exploit the MOP by using that the drift of </($) must vanish for the 
optimal strategy. In contrast, Cerny and Kallsen [4] obtain a by closely examining the 
structure of the optimal strategies tp^'^ for variable r, and they prove its properties using 
the optimality of ip^'^ via martingale orthogonality conditions. They do not explicitly 
use dynamic programming and never mention the MOP. 

The next proposition summarises the most important results for the unconstrained 
case C = M. d . We give no proof; this all follows directly by specialising our earlier results. 
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Proposition 6.1. Suppose that S is in H\ oc {P)- Then: 

1) There exists an RCLL submartingale L = (L t )o<t<T, called opportunity process, 
such that for each and r G So,t> ^ e process 

J t (&,x,r) = (x + J^ u dS u ) 2 L t , 0<t<T 

is a submartingale for every i? G B u>ii/i i? = on [0,r]. Moreover, J(t9; x, r) zs a 

martingale for d G 6 = on [0, r] i/ and on/y if $ = y^' 1 ") is optimal for 

(13.21) . TTie process L is given explicitly as an RCLL version of 

L(t) : = ess inf {#[|1 - <p u dS u \ 2 \F t ] | </? G G us'to y? = on [0,t]}, < t < T. 

2) Suppose that L and L_ are &o£/i > and i/iat t/iere exists a solution {p( 1,r ) to (13.21) 

x = 1 /or any stopping time r. Then the joint differential characteristics of 
(S,L) satisfy 

b L = LJb T (c)- l b (6.6) 

and we have V(l,(f^ l ' T ') = £((— al] T ,r]) *<S') w'i/i a = (c) _1 6. ^4 sufficient condition 
for the assumptions in 2) is that there exists an EaMM Q for S with jp g L 2 (P). 

3) Conversely, let £ be a semimartingale such that 

a) £ and its left limit £_ are (0, l]-valued and £? = 1. 

b) Tne jomt differential characteristics of (S, £) satisfy 

c) For a := (c) _1 o, we have that 

A« := £ ((-al lrjTl ).5)_al IrjTl ) G B. 

Tnen ^ 1,T ^ := — A^ r ' is the solution to (13. ip win x = 1 for each r G So,t, and L := £ 
is the opportunity process. 

Note that the equation (16 .6p for the joint differential characteristics of (S, £) is the same 
as (3.32) in [4]. Moreover, parts 2) and 3) of Proposition 16 . 1 1 essentially recover Theorem 
3.25 of jl]; our result is actually even stronger since we do not need the assumption from 
[I] that £((— alj Tt Tj) 'S)£ is of class (D) for each stopping time r G <So,t- 

The results of Cerny and Kallsen [4J show (as repeated in part 2) of Proposition 16.11) 
that a sufficient condition for the existence of all optimal strategies yft-' T > for r G <So,t 
as well as for strict positivity of L and L_ is the existence of an EaMM Q for S with 

G L 2 (P). Bur next theorem sharpens this into a precise characterisation by giving 
necessary and sufficient conditions. This result is also one reason why we have introduced 
the notion of (£, Z^) -martingales in the precise form of Section [2J 

Theorem 6.2. For S G H 2 oc (P), the following are equivalent: 
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1) The opportunity process L and its left limit L_ are (0, l]-valued and there exists a 
solution ^ 1 ' r ) to ( 13. 2ft witt x = 1 /or an?/ stopping time r G 5o,r- 

2) There exist N G •A^oi oc (-f > ) an( ^ swc ^ (£, Z N ) with £ = £(N) is regular and 
square-integrable and S = Sq + M — (M, N) is an £ -local martingale. 

Proof. The implication "2) ==> 1)" is easy. Indeed, the closedness in L 2 (P) of Gt{Q{C)) 
obtained from Theorem 12. 161 implies the existence of all the Ip^ 1 ' 7 ^ by taking C = M. d lj T) Tj, 
and strict positivity of L and L_ is from Lemma 13.41 We prove the converse implication 
"1) =>- 2)" in several steps. 

1) Fix r and use Lemma [33] to write V{l,ip^) = Effi^'S) = £{{^ 1 ' T H Jr>n ) -S). 
As in Lemma [3.3[ using that L + = L~ = L, consider the process M^' T ^ = V(l,(p^ 1,T ^)L 
and the square-integrable martingale 1] t ,t] * M^ 1 '^ = 1] t ,t] * (f^'^L). Because 
L_ > 0, we can write L = L £(K'). Moreover, Corollary 14.21 and its proof give that ip^' T ' 
coincides on the set ]r, T] R {V-(l,(p^ l ' T ') ^ 0} with the minimiser if] of the function q, 
which is ip = —a = — (c) _1 6 by (16. 4p . so that V r (l,^ 1 ' T ^) = £((— alj T)T j) •5'). This implies 

M(i.-) = Z7 + l ]r , T] • (V(l, ^ T) )L £{K')) 

= U + l lTiT] • (5 ((-al lT)TI ) * S^j L T £ (l ]TiT] • K') ) 

= L^(l lr>rr ^) (6.7) 

by Yor's formula, with N := —a * S + K' — [a * S, K'\. Moreover, by Lemma 13.31 for 
•d := ±l] r „ ,r n+fc ] for a localising sequence with S' 7 " 1 G 1-L 2 (P) for all m, we obtain that the 

product of Tn S and M^ 1 '^ is for each n a local martingale (with (T n +k)ken as localising 
sequence) . 

2) At the end of step 1), we have glossed over a point that we must settle now. 
While ( 16. 7p is correct as it stands, the subsequent definition of N on all of [0, T] requires 
us to show that a is in C(S). To do that, we recall that K' = -L • £, (this is called 

the extended mean- variance tradeoff process in Definition 3.11 in |4J) and introduce the 
opportunity-neutral measure P* ~ P by := e ^ Lq t^ a k'^ • Then Girsanov's theorem 

(see Lemma A. 9 in jl]) gives as in the proof of Lemma 3.17 in jl] that b s,p * = l+ ^ AK i and 
[S , ] p ' p * = c s,p * m B = 1+ £ a k' *B. Note that A K is increasing because L is a submartingale, 
and Corollary 14.21 with ( 16. 3 p gives 

A * = TZ' AL = TZ' B = ( - ^rnm^ Mdd (iP;L))'B = (6 T (c) -1 6) «S. 

So we obtain from a = — (c) _1 o and since [5'] p ' p — (M s,p ) is nonnegative definite that 

/ \adA s > p *\ + Ja T d(M s > p *)a = (\a T b s > p *\ + a T c M > p *a)>B < < 2A K \ 

which shows that a is in both C(A S ' P ) and C 2 oc (M s,p *) and therefore in C(S). Hence N 
is well defined and a semimartingale. As in Section [2] define the stopping times T := 
and T m+ i = inf{£ > T m \ Tm £(N) t = 0} AT, and note that (T m ) increases to T stationarily. 
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3) Step 1) with r = T m implies that lyr m ,T\ -M^ T ^ = L Tm l JTm ,T} -£(% m ,T] * AO is for 
each m a square-integrable martingale. By Remark l2.8l this implies that A" is in \ oc {P) 
because L > 0. Then step 1) also shows that (£, Z ) with £ = £(N) and = L is 
regular and square-integrable, since the product of L Tm and Tm £(N) = £(l]r m ,T] * AQ is 

M^' Tm ). Finally, step 1) with r n replaced by r n AT m yields for n — » oo that 5 is an £-local 
martingale. This ends the proof. □ 

An alternative description of L and hence of the optimal strategies is via the BSDE 
( I4.19P in Corollary 14.61 Combining (16. 3p with the fact that ^ = q ± in Section HI we 
obtain that the BSDE system (14.191) (for L ) collapses to the single BSDE (for L) 

L = (LJ) T (c)- l b)'B + H L 'S c + W L *(ii s -u s ) + N L , L T = 1. 

By also using (16.11) . (16. 2p and (I4.15p - (l4.17p . we can rewrite the drift term (with respect 
to B) into a more explicit form and obtain 

L = H L -S C + W L * (/i 5 - v s ) + N L 

aaL+w ^ u) -^ l uf^ u) ) T 

x (S + / „^ (l + ^ + ^(")-^) ^ - 

x (*> + AAL + W ; L ("> - ftuFMu))L_ ]-B, Lr = l. (6.8) 

This is much simpler than the constrained case because we no longer have a coupled 
system of BSDEs (for L ± ). Note that (EE} has one more term than the otherwise identical 
equation (3.37) in jl]; it seems that Cerny and Kallsen |3] have somewhere lost AA L , as 
has also been noted by other authors. 

6.2 The continuous case 

To the best of our knowledge, all results on the Markowitz problem under constraints 
in continuous-time models have been obtained when S is continuous. Before discussing 
individual papers, we therefore explain how our results simplify for continuous S. 

First of all, Lemma [3.51 yields that V(x, Lp^ x,T ^) = x £(ip( x ^'S). So if (EI]) (when we 
start from r = 0) has a solution, the process V(x, ^ x ' ^) has a unique sign on all of [0, T\ 
because the stochastic exponential of a continuous process never hits 0. One can then 
show with some extra work that 

^ :=x^((^- )i Ir , rI ).5)^'°)i Ir , rI = VT{x X ~ ix , 0) / xfi) Mr,n 

is optimal for ( 13. 2 j) (when we start from r); more precisely, this can be done if we have the 
existence of an optimal strategy Lp( x ' T "> for all (x, r) or if the constraints correspondence 
C has convex closed cones as values. So if S is continuous, we basically do not need to 
study all the conditional problems; it is enough to understand and describe ^ x,0 \ 
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In the local description in Section HJ we next see in ( 14. 2 j) that g 2 ' 1 * 1 = when S* has no 
jumps; so (14. 3 p gives g 1 * 1 = g 1 ^ and (14. ip shows that g + and g" only depend on £ + and 
respectively. This implies in turn that the two coupled equations in (14. 5p in Theorem 14.11 
decouple; and since we have already seen above that V(x, <p) has a unique sign on [0,T], 
we need in fact only one of those two equations (depending on the sign of x). 

To describe the optimal strategy Lp( x >°\ we must find the minimiser ijj(- x > ) of g + or g~ 
(depending on the sign of x). Because g ± are simple quadratic functions of ip, as the terms 
g 2,± are absent, finding their minimisers over the constraint set K is straightforward in 
principle. But explicit (closed form) expressions can be expected only in special cases. 

Conversely, Theorem 14 . 4 1 allows us to construct a solution Lp^ x ^ to (13. ip from a solution 
to the BSDEs in (I4.18p . Those equations take the more explicit form 

£ ± = - inf ^{ifj-SJ^-B + H^-M + N^, £% = \ (6.9) 

with 

^{ip; S, = £^ T c s ip ± 2£^ T b s ± 2i(j T c s H e± . 

In the unconstrained case C = K = M. d , we can find the minimal value of f) 1 * 1 explicitly 
by completing the square. Since we then also need not distinguish between £ + and t~, as 
seen in Section I6.1[ the BSDE (16. 9 p becomes (after doing the computations) 

L = H L -M + N L + l(b s + c s ^\c s )- 1 (b s + c s ^\l\-B, L t = 1. (6.10) 



This equation can also be found in Kohlmann and Tang [18] , Mania and Tevzadze [23] or 
Bobrovnytska and Schweizer [3], among others. Of course, (16.101) can also be obtained as 
a special case of (16. 8p by simply dropping there all the jump terms. Note that even if S 
is continuous, L need not be, due to the presence of the orthogonal martingale term N L . 

After these general remarks, let us now discuss and compare the most important results 
in the literature so far. 

We start with Hu and Zhou [13], Labbe and Heunis [20] and Li, Zhou and Lim [22]. 
They all use for S a multidimensional Ito process model as in Example 12.151 of the form 

dS t = diag(S t ) ((/i t - r t l) dt + a t dW t ) (6.11) 

with a vector drift process fi and a matrix volatility process a. An important assumption 
is that dimiS = dimVF and that a is invertible (even uniformly elliptic); this means that 
the model without constraints is complete and implies that the projection II 5 on the 
predictable range of S is simply the identity. Finally, the constraints are given by closed 
convex cones K which are constant (i.e. do not depend on t or uS). 

In [13], the approach is to first study a more general constrained stochastic linear- 
quadratic (LQ) control problem and then derive results for the Markowitz problem as 
a special case. One inherent disadvantage is that this usually provides less intuition 
and insight than a direct approach as in our paper. At the more abstract level, [T3] 
prove verification theorems; they show how solutions to certain BSDEs induce solutions 
to certain LQ control problems and also prove existence of solutions to their BSDEs 
under suitable conditions. In the context of the model (16.111) . one key assumption is 
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that the instantaneous Sharpe ratio process A := cr _1 ( / u — rl) = cr T {aa 1 )^ 1 ^ — rl) is 
uniformly bounded] this is exploited to prove solvability of the BSDEs by using results 
of Kobylanski [IT] . Moreover, the arguments exploit (via the use of BSDE comparison 
theorems) that the opportunity processes are continuous since the filtration generated 
by the driving Brownian motion has no discontinuous martingales. Boundedness of A 
also implies the existence of an EoMM Q for S with £ L 2 (P); in fact, one can 
take for Q the minimal martingale measure given by dQ = £(— A • W)rdP. Theorem 
I2.16l then implies the closedness in L 2 (P) of Gt(&{K)) and hence the solvability of (13. ip . 
Actually, boundedness of A even implies that the minimal martingale measure satisfies the 
reverse Holder inequality R2(P), so that Gt(Q(K)) is closed in L 2 (P); see Remark [2. 171 
Moreover, the opportunity process L from Proposition 16.11 is uniformly bounded away 
from due to the reverse Holder inequality Rz^P), and hence so are both L ± because 
they dominate L. As already commented before Lemma H~7] the solution to (I4.18P is then 
also unique within that class of processes. But for applications, one serious drawback of 
assuming A bounded is that this restrictive condition is often hard to check or even not 
satisfied in specific (e.g. Markovian) models for S. Moreover, we could not find in [13] 
any explanation where the BSDEs come from so that the presentation seems to us not 
fully transparent. One simple illustration is that the authors of [13] also observe that one 
needs only one of the two BSDEs; but their explanation seems to miss that this is directly 
due to the continuity of S, as explained above before ( 16. 9p . 

In [20], the final setting is even more special since the coefficients /i, r, a in (16.1 ip are all 
deterministic functions. Labbe and Heunis |20j use convex duality to obtain existence and 
the structure of the solution to the Markowitz problem, by first solving a dual problem 
and then constructing from that the desired primal solution. More precisely, existence is 
proved for random coefficients and even (fixed) convex closed, but not necessarily conic, 
constraints if A = cr _1 (//— rl) is bounded (as in [13]). However, the results on the structure 
of the optimal portfolio are obtained by first studying and solving the HJB equation for 
the dual problem, and this hinges crucially on the assumption of deterministic coefficients. 
It also needs closed convex cones for the constraints. From our perspective, the use of 
duality is in general not really necessary to obtain the structure of the solution to the 
primal problem. Duality is very often useful for proving the existence of a (primal) 
solution; but if that is achieved differently (or assumed), structural results about the 
solution can usually be derived directly in the primal setting, as we have done here. 

Finally, one of the earliest papers on the Markowitz problem under constraints in a 
continuous-time setting is due to Li, Zhou and Lim [22J. The coefficients n,r,a there 
are deterministic functions, A = o~~ l ([i — rl) is again bounded, and constraints are given 
by C = K = IR+ (no shortselling). The treatment in [22J combines LQ control with 
Markovian and PDE techniques; instead of working with BSDEs as in [13], the authors of 
[2"2"] study the (primal) HJB equation associated to the Markowitz problem, construct for 
that a viscosity solution, and use a verification result to then derive the optimal strategy. 
A major step in their proof is to deal with a potential irregularity in the HJB equation 
(the set T3 in [22], where v(t, x) = 0). From our general perspective, there are two 
comments. One is that a (well-hidden) assumption in [22] is that the vector n — rl is in 
M.^_ (since the coefficient B in the abstract problem (3.1) in |22j must lie in the positive 
orthant). By looking at our functions Q^ 1 = Q 1 ^ in (14. ip and using that K = we then 
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directly obtain as minimisers ifj + = and ip~ = ((x T ) _1 7f, where tt denotes the projection 
on a T K = er T M^ of A = o" _1 (/i — rl); so the optimal strategy is almost directly given. 
Secondly, the fact that V(x, </5) has a unique sign implies that the potential irregularity 
in the HJB equation is actually not relevant since the optimiser will not go there; this 
explains why there is no genuine smoothness problem in [22J. 

While all the above papers consider models which are complete without constraints, 
there has also been some recent work going beyond such restrictive setups; we mention 
here Jin and Zhou [16] and Donnelly [TT]. Both use duality techniques to prove the exis- 
tence of a solution; [TT] has an Ito process model with regime-switching coefficients and 
(deterministic and constant) convex constraints, while pjj] studies no-shortselling con- 
straints (C = K = M+) in an incomplete Ito process model. The latter paper also obtains 
the optimal strategy more explicitly for the special case of deterministic parameters /i, r, a; 
this is possible because (like in |20j) the dual problem becomes much simpler under that 
condition. All in all, it seems fair to say that even for continuous S, our results on the 
structure of the optimal strategy in the Markowitz problem under constraints contain and 
substantially extend all the available literature so far. 

The last statement needs an important clarification. We focus here on constraints 
on strategies and there in particular on the structure of the optimiser for the Markowitz 
problem. There have been quite a few papers on the Markowitz problem (usually in 
the form (12. 2p of minimising the variance subject to a given mean for the final wealth) 
with the additional constraint of having a nonnegative wealth process. One of the earliest 
papers on this topic is due to Korn and Trautmann [19], and more recent contributions 
include Bielecki, Jin, Pliska and Zhou [2] and Xia [32J. In most cases, the discussion and 
solution goes as follows. If one has a good equivalent martingale measure Q, say, then 
nonnegative wealth V(x, #) > as a process is equivalent to having nonnegative final 
wealth, Vr{x,$) > 0. If one also has a complete model, every final payoff is replicable 
and so it is enough to solve the static Markowitz problem over (nonnegative) final wealth 
only. This is done in [19] via duality and utility-based techniques and in [2] via Lagrange 
multipliers. The paper by Xia [32J is a little different; it actually reduces the problem of 
minimising E[\y — Vr(x, t?)| 2 ] for continuous S and y > x by observing (and proving) that 
it is optimal to first minimise the expected squared shortfall E[\(y — Vr{x,'d)) + \ 2 } and 
then stop the corresponding wealth process as soon as it hits y. But in all these cases, a 
nonnegative wealth constraint is substantially easier to deal with than constraints imposed 
on strategies. 
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